arXiv — Machine Learning
500 articles archived · Visit source ↗ · RSS
-
arXiv — Machine Learning research 7d ago
TEMPEST: Temporal Embeddings for Scalable Driver Identification via Angular Margin Learning
arXiv:2610.06855v1 Announce Type: new Abstract: Scalable driver identification requires embedding models that maintain discriminative performance as fleet size grows, yet existing triplet-loss formulations degrade rapidly with driver pool size and overfit to session-specific…
35 -
When Does External Guidance Help LLM Reasoning? A Bias-Variance Theory of Guidance-Augmented GRPO
arXiv:2610.06861v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) has become the dominant paradigm for eliciting multi-step reasoning in large language models, and a recent wave of methods (LUFFY, ExPO, PAPO, TAPO) further augments RL with…
4 -
-
Comparative review of hybrid forecasting models for short-term prediction of building thermal load
arXiv:2610.06881v1 Announce Type: new Abstract: In this paper, a comparative review of different hybrid models for short-term forecasting of building thermal demand is carried out. Particularly, the assessment tackles the comparison of data-driven models enhanced with other…
9 -
Learning When to Refine: Long-Horizon Reinforcement Learning for Budgeted Neural-Operator PDE Solvers
arXiv:2610.06883v1 Announce Type: new Abstract: Neural operators provide fast surrogates for time-dependent PDEs, but autoregressive deployment creates a refinement-allocation problem: prediction errors vary over space and time, while only a finite number of local corrections…
22 -
Event-Driven ML Pipeline Orchestration for Manufacturing: An AWS Industry Experience
arXiv:2610.06890v1 Announce Type: new Abstract: We present an industry experience report on three years of operating an event-driven cloud infrastructure for continuous machine learning training in automotive manufacturing. Our system orchestrates GPU-accelerated training of…
5 -
Learning from Unreliable Trajectories: Adversarially-Robust Federated Q-Learning
arXiv:2610.06918v1 Announce Type: new Abstract: We study federated reinforcement learning in which multiple agents interact with a common Markov decision process and communicate through a central server to collaboratively learn the optimal state-action value function. Our goal…
11 -
AttSVD:Prompt-Adaptive Low-Rank KV Cache Compression via Attention-Guided SVD
arXiv:2610.06927v1 Announce Type: new Abstract: The key-value (KV) cache of autoregressive transformers grows linearly with context length and dominates memory at long context. Most training-free remedies evict low-importance tokens, an irreversible choice along the sequence…
6 -
Near-Optimal Sample Complexity for Recursive Entropic Risk Reinforcement Learning with a Generative Model
arXiv:2610.06931v1 Announce Type: new Abstract: In this paper, we study the sample complexities of value and policy learning in finite discounted Markov decision processes (MDPs) under recursive entropic risk preferences with risk parameter \(\beta\neq 0\), assuming access to a…
8 -
QiYao-I: A Manifold Based Foundation Model for Irregular Multivariate Time Series Forecasting
arXiv:2610.06936v1 Announce Type: new Abstract: Irregular multivariate time series forecasting is a challenging yet important problem in real-world applications, where observations are often irregularly sampled and asynchronously recorded across variables. Existing time series…
13 -
Learning to Remember: Distilling Memory Retention for Compact Recurrent Neural Networks
arXiv:2610.06942v1 Announce Type: new Abstract: Deep learning models, particularly recurrent neural networks and their variants, such as long short-term memory, have significantly advanced time series analysis. These models capture complex, sequential patterns in time series,…
7 -
Learning to Decide, Not to Reason: Parameter-Efficient Decision Operators via Low-Rank Activation Steering
arXiv:2610.06950v1 Announce Type: new Abstract: Injecting skills into a frozen language model currently costs a million parameters and a reinforcement-learning pipeline. We introduce \method{}, a System-1 decision operator trained by behavior cloning that lowers this cost by…
7 -
Do Neural PDE Solvers Learn the Right Dynamics?
arXiv:2610.06952v1 Announce Type: new Abstract: Neural PDE solvers can achieve low prediction errors, but do they reproduce the dynamics of the systems they model? Prediction scores alone offer an incomplete answer: they measure agreement with reference solutions but provide…
37 -
EVFormer: An Egocentric Vision-EMG Bidirectional Attention Model for Bimanual Hand Pose Estimation
arXiv:2610.06970v1 Announce Type: new Abstract: Egocentric bimanual hand pose estimation is important for virtual interaction, wearable control, and rehabilitation, but visual observations are often degraded by self-occlusion, hand-hand contact, and object manipulation. We…
15 -
Uncertainty in Representation Learning on Knowledge Graphs
arXiv:2610.06974v1 Announce Type: new Abstract: Knowledge graph embedding (KGE) methods represent entities and predicates in continuous vector spaces to infer missing knowledge. Despite strong benchmark performance, their predictions often lack principled reliability guarantees,…
9 -
-
An Information-Theoretic Evaluation Framework for Benchmark and Model Diagnosis in Knowledge Tracing
arXiv:2610.06988v1 Announce Type: new Abstract: Knowledge tracing (KT) models are predominantly evaluated using aggregate metrics such as area under the curve (AUC) and accuracy. However, these global scores obscure where the remaining errors originate and fail to indicate…
17 -
-
DART-ES: Difficulty-Aware Reweighting and Targeted Replay for Fine-Tuning LLMs with Evolution Strategies
arXiv:2610.06993v1 Announce Type: new Abstract: Evolution Strategies (ES) enable memory efficient full parameter fine-tuning of large language models (LLMs) using only forward computation. However, standard ES uniformly averages rewards across problems and compresses problem…
16 -
Mask-Guided KV Cache Eviction in Block Diffusion Language Models
arXiv:2610.06996v1 Announce Type: new Abstract: Block diffusion language models keep a large key-value (KV) cache throughout generation and attend to it at every denoising step, limiting both memory capacity and generation speed. Reducing these costs requires deciding which past…
35 -
Should We Skip Diffusion?
arXiv:2610.07002v1 Announce Type: new Abstract: Diffusion models learn semantic representations while generating images. In the Decoupled Diffusion Transformer (DDT), a condition encoder provides features that guide a velocity decoder in denoising. To enable effective denoising…
29 -
STOCK-JEPA: Prior-Anchored Latent Revision Representation Learning in Equity Markets
arXiv:2610.07006v1 Announce Type: new Abstract: Learning effective representations helps characterize the structure and dynamics of equity markets from financial data with a low signal-to-noise ratio. Black-box deep models can capture complex patterns but may overfit sample…
24 -
Identifiable World Models from Pretrained Diffusion Representations
arXiv:2610.07028v1 Announce Type: new Abstract: Diffusion-based world models can generate and predict trajectories in high-dimensional dynamical systems, but predictive accuracy does not imply that their latent coordinates recover the underlying state variables or causal…
11 -
Shaping the Wind: Nested Potentials for Kinematically Admissible Urban Wind Prediction
arXiv:2610.07033v1 Announce Type: new Abstract: Predicting transient urban winds is fundamental to understanding urban microclimates and designing climate-resilient cities. Building-resolving large-eddy simulation produces detailed incompressible urban wind fields at substantial…
28 -
The Premise Is the Problem: Exchangeability Failure in Self-Monitored Test-Time Adaptation
arXiv:2610.07038v1 Announce Type: new Abstract: Modern forecasting models are often updated after deployment so they can respond to changing data. These updates can also make predictions worse, so practical systems need a reliable monitor that can detect harmful changes and…
30 -
TRIAGE: Direction-Aware Mismatch Stabilization of Native NVFP4 Reinforcement Learning
arXiv:2610.07043v1 Announce Type: new Abstract: Low-precision execution can substantially accelerate reinforcement learning (RL) for large language models, but discrepancies between learner and sampler execution can destabilize policy optimization. In this paper, we characterize…
11 -
Skillful Data-Driven Subseasonal Soil Moisture Forecasting: Prospects and Limits for Flash Drought Prediction
arXiv:2610.07060v1 Announce Type: new Abstract: Despite substantial progress in short-to-medium-range weather forecasting, predicting high-impact events such as flash droughts remains a key challenge for both early warning operations and physically-based subseasonal-to-seasonal…
37 -
Learning to Simulate Individuals from Macro Social Signals
arXiv:2610.07062v1 Announce Type: new Abstract: Large language models are increasingly used to simulate how individuals respond to new situations, yet the behavioral reasoning behind these responses is either inherited from pretraining or learned from individual-level…
25 -
What Must Replay Preserve? Separating Correctable Bias from Class Correspondence
arXiv:2610.07077v1 Announce Type: new Abstract: Class-incremental learning must recognize all classes seen so far without task labels. Logit replay methods such as DER and DER++ mitigate forgetting by matching the model's past predictions on stored examples. Deleting this…
14 -
Few-Shot Bioactivity Prediction with Meta-Learning under Assay Heterogeneity
arXiv:2610.07079v1 Announce Type: new Abstract: Accurate bioactivity prediction is a central challenge in early-stage drug discovery, as individual assays often contain too few measurements to train reliable models independently. Meta-learning offers a principled approach to…
22 -
-
SchemaFill: Efficient LLM Tool Calling via Slot-Parallel Speculative Decoding
arXiv:2610.07086v1 Announce Type: new Abstract: LLM agents interact with external systems by generating structured tool calls. Given a user request, conversational context, and a catalog of tool schemas, a tool-calling model must select tools and generate their arguments,…
38 -
Muon Is Theoretically Wrong For Convolutions, But Empirically Effective
arXiv:2610.07103v1 Announce Type: new Abstract: Muon, an optimizer known for its efficiency, has a clear interpretation for matrix-valued updates, but convolutional kernels are stored as four-dimensional tensors. Standard implementations reshape these tensors into matrices, a…
38 -
LiLib: Lifelong Air-to-Ground Path-Loss Prediction on UAVs via a Drift-Triggered Model Library
arXiv:2610.07111v1 Announce Type: new Abstract: UAVs that act as relays or base stations need accurate air-to-ground path-loss predictions for rate adaptation and placement, but propagation conditions change as a UAV moves between suburban, urban and high-rise areas, and the…
34 -
Sample-Optimal Estimation of the Fr\'echet Inception Distance
arXiv:2610.07114v1 Announce Type: new Abstract: The Fr\'echet Inception Distance (FID) is widely used to evaluate generative models, but its empirical plug-in estimator suffers from finite-sample bias [BSAG18, CF20]. We study the sample complexity $n$ of estimating FID to error…
21 -
Will the Judge Flip? Predicting Position-Sensitive LLM Judgments from Residual Stream Activations
arXiv:2610.07115v1 Announce Type: new Abstract: The order in which candidate responses are presented can change an LLM judge's verdict. Detecting such a position flip ordinarily requires judging each pair in both orders, which doubles the number of judgments. We investigate…
33 -
SoloQ: Calibration-Free Quantization for Diffusion Language Models
arXiv:2610.07121v1 Announce Type: new Abstract: Diffusion large language models dLLMs) have emerged as a promising alternative to autoregressive language models through bidirectional diffusion-based token generation. However, their growing model sizes and high inference costs…
37 -
The Implicit Bias of Hyperbolic Representation Learning for Multiclass Data: A Busemann Risk Perspective
arXiv:2610.07131v1 Announce Type: new Abstract: We study the implicit bias of Riemannian gradient flow for hyperbolic multiclass classification with fixed class prototypes in hyperbolic space $\mathbb{H}^n$. Our framework accommodates general permutation invariant relative…
11 -
Adversarial Training for Deep Hedging in Nonstationary Markets
arXiv:2610.07162v1 Announce Type: new Abstract: Deep hedging learns trading policies from historical or simulated market trajectories, yet under nonstationarity these training paths may not represent future market conditions. We propose WRAP (Wasserstein-Reweighting Adversarial…
16 -
A theory of platonic representations in language models
arXiv:2610.07168v1 Announce Type: new Abstract: Representations of translated sentences are similar in the inner layers of multilingual language models -- an observation connected to the platonic representation hypothesis, yet unexplained theoretically. We provide an explanation…
20 -
CLM-as-a-Judge: Evaluating an Open Contrastive Decision Model on Public Judge Benchmarks
arXiv:2610.07177v1 Announce Type: new Abstract: An open contrastive decision model is near chance as a judge on the hard public benchmarks: Contrastive-LM/CLM-v0.1-8B scores between 0.351 (best- of-four, chance 0.250) and 0.593 (pairwise, chance 0.500), is statistically…
5 -
Learning Scientific Exploration from Human Research Decision Trajectories
arXiv:2610.07184v1 Announce Type: new Abstract: A key challenge in building AI systems for scientific research is enabling $\textit{scientific exploration}$: the systematic process of investigating unknown phenomena or ideas to gain new knowledge through sequences of research…
21 -
Exact Unlearning via Quantized Sufficient Statistics
arXiv:2610.07197v1 Announce Type: new Abstract: Exact unlearning requires a deployed predictor to match one rebuilt without the information named by a deletion request. Existing general-purpose exact methods localize retraining through disjoint shards, but every request still…
32 -
Distributionally Robust Mixture-of-Experts Training
arXiv:2610.07207v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) transformers scale capacity by activating only a few experts per token, but this sparsity creates a hidden reliability problem: when routing is imperfect, load-balanced models may send tokens to experts…
22 -
Can LLM-assisted regularization increase forecast accuracy for migration flows in low data regimes?
arXiv:2610.07208v1 Announce Type: new Abstract: Predicting migration flows remains a significant challenge for traditional gravity-based forecasting models, which primarily rely on structured socio-economic indicators such as economic disparity, political stability, and…
14 -
Reward-Driven Learning under Prompt-Level Differential Privacy
arXiv:2610.07212v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) trains a language model on problems that may themselves be confidential, and the trained model can reveal which problems it saw. We study RLVR under prompt-level differential…
12 -
Constant-Curvature Sliced Gromov-Wasserstein for Heterogeneous Cross-Curvature Alignment
arXiv:2610.07218v1 Announce Type: new Abstract: Recent advances in representation learning have highlighted the utility of constant-curvature models, such as hyperbolic and spherical spaces, for modeling complex data. Mixed-curvature models further enhance this by integrating…
4 -
Data, Numbers, and Geometry: Three Tutorials on Numerical Methods, Machine Learning, and Evaluation
arXiv:2610.07220v1 Announce Type: new Abstract: We present three practical tutorials on numerical computation and machine learning for mathematical research, developed for the DANGER: Data, Numbers, and Geometry workshop held at the Banff International Research Station in April…
29 -
Minimal Witness Reinforcement Learning
arXiv:2610.07226v1 Announce Type: new Abstract: ``What are the irreducible conditions that are sufficient to produce an outcome?'' is one of the most common questions that recur across computation and science. Its answers, the minimal sufficient witnesses, are what we mean by…
8 -
Conditional Flow Matching for Transport Between Markov Processes
arXiv:2610.07229v1 Announce Type: new Abstract: Motivated by sequence-to-sequence transport in the context time-series domain adaptation, we study the problem of transportation between trajectories of Markov processes. Given a limited number of trajectories from source…
35