arXiv — Machine Learning
500 articles archived · Visit source ↗ · RSS
-
arXiv — Machine Learning research 7d ago
Benchmarking Time Series Foundation Models for Load Forecasting Under Covariate Uncertainty
arXiv:2610.07232v1 Announce Type: new Abstract: Accurate short-term load forecasting (STLF) is essential for the reliable and efficient operation of modern power systems. While time series foundation models (TSFMs) have recently demonstrated remarkable performance across a wide…
21 -
Learning What to Distill: Bilevel Top-K Token Selection for Self-Distillation in Large Language Models
arXiv:2610.07247v1 Announce Type: new Abstract: Large language models have shown strong reasoning capabilities, but their high inference costs make knowledge distillation an important approach for transferring such capabilities to compact models in resource-constrained…
15 -
Neural Fields Encode Adaptation Geometry
arXiv:2610.07253v1 Announce Type: new Abstract: Neural fields are usually evaluated by how well they reconstruct an observation. We show that this misses two useful properties of a fitted network: how easily it can adapt to new observations, and what its weights retain from…
34 -
Neural Algorithmic Reasoning for Graph Saddle Point Problems
arXiv:2610.07255v1 Announce Type: new Abstract: Neural algorithmic reasoning, or aligning a neural network with an algorithmic paradigm, has emerged as an approach to solving polynomial-time-solvable and computationally harder combinatorial optimization problems. We propose a…
28 -
Algorithmically Aligned Neural Agglomerative Tree Construction
arXiv:2610.07271v1 Announce Type: new Abstract: Linkage algorithms for hierarchical clustering (HC) are a powerful and efficient framework for constructing clustering trees, yet it is often unclear which merge rule best suits a given dataset or task. In contrast, neural…
30 -
Lock-in EP: An In-Situ Training Algorithm for Oscillatory Hardware
arXiv:2610.07283v1 Announce Type: new Abstract: Analog hardware platforms offer the potential to reduce energy consumption over digital architectures, but in order to succeed, large-scale analog systems must also be able to operate with or recover from the variability of their…
17 -
FlexiFlow: Bandit-based Model Switching in ML Workflows
arXiv:2610.07286v1 Announce Type: new Abstract: Model optimizations help improve inference performance and accuracy of ML workflows. However, relying on a single model to perform inference across all data batches often fails to maximize accuracy and thus overall performance. In…
23 -
ATLAS-AL: Adaptive Trust-Region for Latent Adversarial Searches via Active Learning
arXiv:2610.07323v1 Announce Type: new Abstract: Security evaluation of learning-based systems requires more than just testing the system against a fixed collection of attacks. It requires adaptive mechanisms that can efficiently discover \textit{sets} of inputs that induce model…
10 -
Scale-Invariant Training for Time Series Foundation Models
arXiv:2610.07324v1 Announce Type: new Abstract: Time series foundation models (TSFMs) are trained on large collections of time series datasets that span various morphologies and domains. This setting exposes models to series whose scales -- typical magnitudes of their values --…
29 -
Structuring MoE Expert Selection for Agentic Reinforcement Learning
arXiv:2610.07332v1 Announce Type: new Abstract: Long-horizon LLM agents are frequently implemented using sparse mixture-of-experts (MoE) models, yet the co-design of agentic behavior and MoE structures remains underexplored. In this work, we comprehensively study the connections…
22 -
Weight Oracles: Reading Neural Network Weights with Language Models
arXiv:2610.07334v1 Announce Type: new Abstract: Interpretability methods for neural networks are predominantly reactive: they analyse activations produced during specific forward passes, requiring known inputs to find hidden capabilities such as backdoors. We propose Weight…
28 -
Selective Critique for Cost-Aware LLM Agents in Long-Horizon Decision Making
arXiv:2610.07335v1 Announce Type: new Abstract: Improving the reliability of large language model (LLM) agents in long-horizon decision-making remains a key challenge. When deployed as autonomous agents interacting with complex environments, early mistakes can propagate through…
30 -
CausalBind: Causal Modeling and Learning for Protein-Molecule Virtual Screening
arXiv:2610.07340v1 Announce Type: new Abstract: Protein-molecule virtual screening is increasingly cast as a problem of representation learning in a shared embedding space. Existing methods rely on dense holistic alignment, entangling invariant binding determinants with nuisance…
12 -
Stepped MoE: Segment-Level Routing with Configurable Inference Complexity
arXiv:2610.07348v1 Announce Type: new Abstract: Training large language models (LLMs) is resource-intensive, and adapting them for diverse deployment scenarios with varying computational constraints remains challenging. While elastic architectures enable flexible model…
5 -
RELACE: retrospective likelihood-based action credit estimation for long-horizon language agents
arXiv:2610.07349v1 Announce Type: new Abstract: Group Relative Policy Optimization (GRPO) avoids a separate critic by estimating advantages from rollout groups. For multi-turn agents, however, trajectory-level supervision provides coarse, noisy credit: terminal rewards do not…
38 -
Towards Explainable Benchmarking for Data-driven Post-Wildfire Debris Flow Prediction
arXiv:2610.07358v1 Announce Type: new Abstract: Post-wildfire debris flows (PFDFs) are destructive sediment-laden hazards triggered when intense rainfall strikes recently burned terrain, destabilizing hillslopes and threatening infrastructure, local economies, and community…
26 -
Dynamic Budget Allocation for LLM Evaluation under Hard Resource Constraints
arXiv:2610.07362v1 Announce Type: new Abstract: We evaluate large language models (LLMs) in multi-turn interactions through their time-to-event: the number of interaction steps required to produce an event of interest, such as a successful jailbreak or agentic task completion.…
9 -
Multigroup Fairness and Omniprediction: Separations and Equivalences
arXiv:2610.07374v1 Announce Type: new Abstract: Omniprediction is a learning guarantee which requires a single predictor to be competitive relative to the best hypothesis from a benchmark class for any loss chosen from a family of loss functions. Loss Outcome…
27 -
Inference and learning in sparse autoencoders as natural gradient flow
arXiv:2610.07389v1 Announce Type: new Abstract: Sparse autoencoders are widely used to uncover interpretable features in neural networks, yet reliable recovery remains difficult when features overlap or activate infrequently. These challenges involve both inferring which…
10 -
Fed-BRDECS: Privacy-Preserving and Heterogeneity-Aware Federated Deep Embedded Clustering
arXiv:2610.07399v1 Announce Type: new Abstract: Federated deep clustering seeks to learn clustering-friendly representations from decentralized unlabeled data while preserving client privacy. However, Deep Embedded Clustering (DEC)-style objectives depend on global…
21 -
What pass@k Cannot Measure: Evaluating Diversity and Capability Retention after Post-Training
arXiv:2610.07405v1 Announce Type: new Abstract: pass@$k$, the fraction of problems a model solves within $k$ sampled attempts, is the field's default protocol for deciding whether reinforcement-learning (RL) post-training on verifiable rewards improved a model. At the population…
18 -
Evaluation of Active Feature Acquisition Policies with Tabular Foundation Models
arXiv:2610.07406v1 Announce Type: new Abstract: Active feature acquisition learns policies that sequentially acquire features to maximize information about a target variable. We study how to learn and evaluate such policies from finite offline data using prior-data fitted…
16 -
Learnable Spectral Activations
arXiv:2610.07419v1 Announce Type: new Abstract: Implicit neural representations (INRs) are shaped by the spectral structure induced by their input encodings and activation functions. Existing methods improve fitting primarily by modifying which frequencies are available to the…
11 -
Benchmarking Label-Revealed Online Updates for EEG BCI Decoding
arXiv:2610.07420v1 Announce Type: new Abstract: Electroencephalography (EEG) signals drift over time, which can cause static brain-computer interface (BCI) models to degrade in practice. We present a benchmark for online adaptation and compare two widely used pipeline families,…
4 -
StaFIR: Convex Learning of Stationarity-Aware Causal Filters
arXiv:2610.07430v1 Announce Type: new Abstract: Reducing nonstationarity in a persistent time series entails deciding how much of its temporal dependence to remove. In finance, fractional differencing is often tuned using the Augmented Dickey--Fuller (ADF) test, limiting the…
37 -
Decoupling What from Where: How Should a Small GUI Grounding Model Receive the Action Type?
arXiv:2610.07444v1 Announce Type: new Abstract: A GUI agent decides which action to take and where to take it; we ask how a small grounding model should receive the action type. Fine-tuning Qwen2-VL-2B with LoRA on Android in the Wild, we compare a flat baseline with five ways…
15 -
Fork-and-Flush: Escaping Idea Basins in Autoresearch Agents
arXiv:2610.07447v1 Announce Type: new Abstract: Autoresearch agents tackle open-ended problems by repeatedly proposing candidate solutions, evaluating them, and using feedback to guide subsequent experiments. We show that independent runs of the same agent on the same task often…
21 -
Active Feature Acquisition for Cost-Efficient Temporal Prediction with Reduced Participant Burden
arXiv:2610.07452v1 Announce Type: new Abstract: Accurate forecasting of pathological outcomes is a central problem in psychology. To do so, psychologists often collect intensive longitudinal data. However, in such studies, the desire to acquire a large number of variables for…
26 -
AlignQuant: Tile-Aligned Mixed-Precision Quantization for Efficient LLM Generation
arXiv:2610.07457v1 Announce Type: new Abstract: Fine-grained mixed-precision quantization promises efficient large language model inference, but local precision choices can conflict with regular GPU storage and computation units. This precision-boundary mismatch limits the…
4 -
Interpretable Hypergraph Learning via Neural Additive Models
arXiv:2610.07458v1 Announce Type: new Abstract: Hypergraphs offer a natural framework for modeling networked data, where dependencies among entities are governed by higher-order interactions. While hypergraph learning methods such as hypergraph neural networks have demonstrated…
11 -
Efficient Multimodal Inference through Adaptive Acquisition and Sequential Fusion
arXiv:2610.07466v1 Announce Type: new Abstract: Multimodal systems often encode every available input, even when a subset suffices for prediction. Adaptive acquisition can reduce this cost by using predictions from incrementally fused evidence to decide which modality to encode…
6 -
Structure, Not Belief: Correlated Thompson Sampling from LLM-Derived Covariance in Combinatorial Semi-Bandits
arXiv:2610.07470v1 Announce Type: new Abstract: Combinatorial Thompson sampling (CTS) draws independent posterior samples for every arm, so its exploration dynamics ignore any relation among arms. We study a minimal change to those dynamics: an LLM is queried once for a…
14 -
Adapting to Changes in Agent Behavior via Finite-Depth Policy Sensitivity
arXiv:2610.07475v1 Announce Type: new Abstract: Adapting a reinforcement learning policy to changes in another agent's behavior typically requires a large amount of new interaction data. Policy sensitivity provides a first-order prediction of how a locally optimal policy changes…
30 -
-
Robust Importance Sampling for Rare Events via Constrained Gaussian Mixtures
arXiv:2610.07485v1 Announce Type: new Abstract: We study estimating rare-event probabilities $I = \mathbb{P}(g(\mathbf{X}) > \gamma)$ with $\mathbf{X} \sim \mathcal{N}(\boldsymbol{\mu}, \boldsymbol{\Sigma})$ and general $g : \mathbb{R}^d \to \mathbb{R}$. We address this problem…
7 -
Who Bears the Burden? Learning Responsibility for Shared Constraints in Multi-Agent Reinforcement Learning
arXiv:2610.07491v1 Announce Type: new Abstract: When multiple agents share a cost budget, a common Lagrange multiplier can enforce the aggregate constraint but does not determine how its penalty should be allocated across agents. Uniform penalties ignore heterogeneity in the…
35 -
Source-Learned Reliance for Selective Test-Time Adaptation of Multimodal Time Series
arXiv:2610.07499v1 Announce Type: new Abstract: Multimodal wearable systems must remain reliable when sensor streams become noisy or unavailable. Existing multimodal test-time adaptation (TTA) methods often assess reliability online, but cross-modal agreement can be misleading…
19 -
Harmful SFT Leaves a Continuous Trace in LLM Checkpoint Updates
arXiv:2610.07518v1 Announce Type: new Abstract: Safety auditing of post-trained large language models typically relies on model behavior, requiring model execution and depending on the coverage of available evaluations. This work asks a different question: Do the target…
32 -
Activation Denoising: A Robustness View on Parallel vs Sequential LLM Quantization
arXiv:2610.07522v1 Announce Type: new Abstract: Post-training quantization is a powerful tool for compressing large language models. The most scalable methods quantize every layer in parallel, but quantization errors then compound through the residual stream, as no layer…
12 -
-
Preserving Unstable Modes Through Inverse Dynamics in JEPA World Models
arXiv:2610.07540v1 Announce Type: new Abstract: Robotic systems often exhibit unstable modes, along which small perturbations and disturbances can cause unbounded growth unless corrected through feedback. Controlling such systems from high-dimensional visual observations…
29 -
Foundation Model-Aided Multi-Agent Reinforcement Learning for Wireless Random Access Network Optimization
arXiv:2610.07550v1 Announce Type: new Abstract: Random access (RA) is one of the most foundational medium access control (MAC) layer scheduling schemes for handling unpredictable data traffic from multiple terminals. While multi-agent reinforcement learning (MARL) has been…
33 -
Which and When to Admit: Gradient Admission for Data-Centric Small Language Model Finetuning
arXiv:2610.07553v1 Announce Type: new Abstract: LoRA fine-tuning adapts small language models (SLMs) to heterogeneous instruction data within a low-rank update subspace, making it vulnerable to three structural problems: conflicting gradients that cancel, static data selection…
7 -
Global Transport Couplings for Classifier-Free Guided Flows
arXiv:2610.07555v1 Announce Type: new Abstract: Optimal-transport couplings have been shown to reduce training variance in unconditional flow models, but their role in conditional generation remains unclear. A natural approach constructs separate couplings for each condition,…
17 -
TAFFY: A Task-Adaptive Tabular Foundation Model with In-Context Diversity
arXiv:2610.07559v1 Announce Type: new Abstract: Recent progress in tabular foundation models suggests that training on synthetic tasks can substantially improve in-context learning capabilities, with overall performance largely depending on how well models can infer…
5 -
Learning a Mixture of GFlowNets
arXiv:2610.07562v1 Announce Type: new Abstract: Learning an ensemble of GFlowNets to sample from a discrete target distribution has become a common approach for achieving better state space exploration and convergence than that of a monolithic sampler. However, these methods…
28 -
Complementary Feature Domains: Information Preservation Does Not Imply Predictive-Contribution Preservation
arXiv:2610.07565v1 Announce Type: new Abstract: Complementary Feature Domains (CFD) theory characterizes predictive value as a context-indexed contribution system induced jointly by representations and their realization family. We show that Shannon-information preservation does…
5 -
Mechanistic Interpretability of Atmospheric Rivers in GraphCast
arXiv:2610.07583v1 Announce Type: new Abstract: While AI weather models now rival operational forecasts, how they represent the atmosphere internally remains an open question: feature attribution reveals which input patterns matter, not what the model computes or how it combines…
36 -
Hub for Outliers, Spokes for Inliers: Uniform Latent Space Construction for Dual-Mismatched Semi-Supervised Learning
arXiv:2610.07610v1 Announce Type: new Abstract: Semi-supervised learning typically assumes that labeled and unlabeled data share an identical class distribution and label space. However, this setting is often violated: unlabeled data may be imbalanced and contain unknown class…
24 -
AFA-BANDIT: Provably Near-Optimal Online Multi-Feature Classification Under Budget Constraints
arXiv:2610.07615v1 Announce Type: new Abstract: Active Feature Acquisition (AFA) is a classification problem in which an agent decides which costly features to acquire before predicting each sample's label. Unlike batch AFA, which trains a fixed policy and classifier offline on…
4