arXiv — Machine Learning
500 articles archived · Visit source ↗ · RSS
-
arXiv — Machine Learning research 10d ago
Student-Guided Teacher Distillation for Efficient LLM Task Routing: Positioning Against Jev-Style System-1 Classifiers
arXiv:2610.02516v1 Announce Type: new Abstract: Zero-shot classifiers are useful for routing user requests to specialized LLM tasks, but scoring every request against a large candidate set is expensive: a zero-shot NLI classifier must evaluate one premise-hypothesis pair per…
19 -
Learning the Latent Structure: A Feature-Centric Approach to Graph Data Augmentation
arXiv:2610.02517v1 Announce Type: new Abstract: Graph-structured data plays a pivotal role in modeling complex relationships. However, real-world graphs are often incomplete due to data collection and observational constraints, severely limiting the effectiveness of modern graph…
23 -
Instance-Dependent Regret for CMDPs with Step-Wise Constraints
arXiv:2610.02520v1 Announce Type: new Abstract: We study online learning in episodic tabular constrained Markov decision processes with step-wise safety constraints. In such a setting, the constraints induce a safe subgraph that shapes the variance of cumulative rewards under…
6 -
BaCP: Backbone Contrastive Pruning for Preserving Representations in Extremely Sparse Neural Networks
arXiv:2610.02524v1 Announce Type: new Abstract: Unstructured pruning at extreme sparsity often suffers from representational collapse, causing sharp drops in accuracy. To address this, we study Backbone Contrastive Pruning (BaCP), which regularizes the sparse network's embedding…
28 -
Autoregressive Differentiable Method for Integer Programming
arXiv:2610.02528v1 Announce Type: new Abstract: We introduce an autoregressive differentiable method to solve 0-1 integer programs. We fix an arbitrary order of the binary variables and we train a transformer to predict the next bit while remaining in the feasible set. Our…
33 -
Reward Inflation: A Healthy Stimulus for Reinforcement Learning
arXiv:2610.02545v1 Announce Type: new Abstract: Reward serves as the primary learning signal in reinforcement learning (RL). However, while reward magnitudes are typically held fixed throughout training, their temporal modulation remains underexplored. In this paper, we propose…
35 -
Test-time Multi-agent Coordination by Decomposed Value Gradient Flow
arXiv:2610.02554v1 Announce Type: new Abstract: Offline multi-agent reinforcement learning (MARL) faces a persistent trade-off. Expressive generative policies can represent multi-modal coordination in the data, but cannot distinguish high-value regions, while value-optimized…
33 -
Neuron merging via inverse-activation regression for post-training compression of sigmoid neural networks
arXiv:2610.02559v1 Announce Type: new Abstract: As neural networks continue to grow in scale, model compression is becoming increasingly important for efficient inference under limited computational resources. Structured pruning methods remove neurons or channels that are…
30 -
OpenGameEval: Benchmarking Agentic Programming and Exploration in a Stateful Game Engine
arXiv:2610.02563v1 Announce Type: new Abstract: We present OpenGameEval, a benchmark and evaluation framework for agentic game development inside Roblox Studio. It runs language models as agents in reproducible, stateful game-engine sessions and scores each run with executable…
8 -
DISSOLVR: An Interpretable and Fast Framework for Aqueous and Organic Solubility Prediction
arXiv:2610.02574v1 Announce Type: new Abstract: High-fidelity solubility prediction is fundamental to pharmaceutical development and environmental partitioning, where accurate modeling must couple molecular structure with thermodynamic behavior across diverse chemical…
25 -
Dense Mixture-of-Experts as a Reparameterized Wide FFN: A Granularity Sweep at Fixed Compute
arXiv:2610.02584v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (MoE) models combine learned routing with selection from a large expert pool. We isolate the contribution of dynamic expert combination using a dense analogue: $K$ SwiGLU experts, all active for every…
38 -
Fisher-Guided Submodular Data Selection for Continual Pre-Training of Large Language Models
arXiv:2610.02593v1 Announce Type: new Abstract: Data selection is already a central bottleneck in large-language-model training, where web-scale corpora are noisy and token budgets are finite. In continual pre-training (CPT), it becomes a forgetting-control problem: a poorly…
35 -
How Causality Bridges the Semantic Gap
arXiv:2610.02594v1 Announce Type: new Abstract: Numerical measurements capture how a system behaves, but often leave the meanings of its variables unspecified. Some variables are measured but never labeled, and others are never measured at all. Existing methods assign semantics…
16 -
Activation Sparsity with Weight Approximation for Faster LLM Decoding on Offloaded Weights
arXiv:2610.02598v1 Announce Type: new Abstract: Deploying LLMs on consumer-grade GPUs with insufficient memory to hold their weights can result in prohibitively slow inference, because decoding repeatedly transfers offloaded weights from system RAM or flash storage into GPU at…
32 -
Seer: Maximum Likelihood Regression for Learning-Speed Curves
arXiv:2610.02610v1 Announce Type: new Abstract: The research presented here focuses on modeling machine-learning performance. The thesis introduces Seer, a system that generates empirical observations of classification-learning performance and then uses those observations to…
12 -
Scale-Recursive Rectified Flows for Few-Step Precipitation Ensembles
arXiv:2610.02611v1 Announce Type: new Abstract: Fine-resolution precipitation estimates support flood risk assessment and water management, but coarse satellite products cannot resolve rainfall within each grid cell. Generative models address this ambiguity by producing…
33 -
What Is Lost in Post-Training? Default Collapse and the Loss of In-Context Steerability Across Diverse Perspectives
arXiv:2610.02614v1 Announce Type: new Abstract: AI models serving a heterogeneous population must act on the principles appropriate to each user and context. While post-training has been shown to narrow the views large language models express, prior work has focused on default…
5 -
Quantifying the Value of Constructive Induction, Knowledge, and Noise Filtering on Inductive Learning
arXiv:2610.02615v1 Announce Type: new Abstract: Learning research, as one of its central goals, tries to measure, model, and understand how learning-problem properties affect average-case learning performance. For example, we would like to quantify the value of constructive…
5 -
Online Verification of Language Model Responses Under Cost Constraints
arXiv:2610.02632v1 Announce Type: new Abstract: As large language models are increasingly deployed for multi-step reasoning, verifying the correctness of their outputs has become essential for maintaining reliability at scale. Verifying the correctness of large language model…
28 -
Context-Tower Conversion Preserves Generation While Freezing Retains Knowledge: Low-Budget AR-to-Diffusion Conversion of MoE LLMs
arXiv:2610.02657v1 Announce Type: new Abstract: Converting a pretrained autoregressive (AR) model to a diffusion language model (dLLM) enables parallel generation without pretraining a new model. Published conversion methods differ by roughly three orders of magnitude in…
12 -
Distributed Learning with Selective State Space Models: Architecture-Aware Convergence Analysis
arXiv:2610.02659v1 Announce Type: new Abstract: Modern state space models (SSMs), such as Mamba2, provide a compelling alternative to transformers by combining linear-time sequence modeling with recurrent state-space dynamics. However, the behavior of SSMs in distributed…
26 -
AIGS: Adaptive Incremental Gating System for Online Representation Learning in Non-Stationary Data Streams
arXiv:2610.02661v1 Announce Type: new Abstract: Real-time data streams in Web of Things (WoT) and edge computing environments often evolve through latent regime changes. For online representation learning under strict computational constraints, the central problem is resolving…
24 -
Mind the Refinement Gap: When Safe High-Level Robot Plans Produce Unsafe Executions
arXiv:2610.02662v1 Announce Type: new Abstract: Language-enabled robot systems increasingly combine semantic-graph planning with temporal-logic safety monitors. We investigate a trace-completeness assumption in these systems: whether the high-level action sequence checked by a…
6 -
LEAP: Learning Efficient Action Proposals For LLM Agents
arXiv:2610.02670v1 Announce Type: new Abstract: LLM agents are known to be slow in rollouts. An agent completes a task one step at a time. At each step, it reasons and then chooses an action to execute. The next step and action cannot start until the previous one has finished.…
9 -
RAOA: Alternating-Operator Neural Computation with Programmable Radio Propagation
arXiv:2610.02683v1 Announce Type: new Abstract: Can programmable radio propagation serve as computational depth rather than only as a communication channel or one-shot analog transform? We introduce the Radio Alternating Operator Ansatz (RAOA), a recurrent computing architecture…
20 -
Test-time Calibration Learning for Large Language Model Reasoning
arXiv:2610.02695v1 Announce Type: new Abstract: Reliable large language models (LLMs) must not only produce accurate answers but also express confidence that faithfully reflects their probability of being correct. Such calibration is essential for identifying uncertain…
17 -
Learning from Evolving Errors: Adaptive Iterative Repair for On-Policy Distillation
arXiv:2610.02700v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) supplies dense token-level feedback on trajectories sampled from the student's own policy, a richer training signal than the outcome-level rewards of reinforcement learning. This feedback comes…
17 -
Conditional Capacity and Routing in Mixture-of-Experts Particle Transformers
arXiv:2610.02701v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models can increase parameter capacity without proportionally increasing active computation, but it is unclear how this trade-off behaves in particle-physics transformers. We study dense and MoE Particle…
9 -
MuonIO: Principled Norm-Aware Descent for Embedding Tables and Language Model Heads
arXiv:2610.02705v1 Announce Type: new Abstract: The Muon optimizer derives its update rule for hidden linear layers by solving a local linearization of the loss penalized by the spectral norm, motivated by an RMS-stability argument for dense linear layers. Standard Muon…
8 -
Differential Privacy of Gradient Descent on Perturbed Objectives
arXiv:2610.02716v1 Announce Type: new Abstract: Objective perturbation adds a random linear term to a regularized empirical risk and releases the exact perturbed minimizer. We study the finite computation obtained by releasing the $N$-th iterate of deterministic gradient descent…
14 -
Structural-Functional Brain Connectivity Generation via Multimodal Hypergraph-based Flow Matching
arXiv:2610.02722v1 Announce Type: new Abstract: Structural connectivity (SC) and functional connectivity (FC) provide complementary information on interactions between brain regions and are widely used in neuroimaging studies of neuropsychiatric disorders. Generative modelling…
13 -
Bellman Error Minimization Via Linear Programming Normalization
arXiv:2610.02730v1 Announce Type: new Abstract: This paper proposes a new functional approximation approach to reduce Bellman error in high-dimensional dynamic programming and Reinforcement Learning problems. Using a classic dynamic programming problem (network capacity control…
16 -
Inner Momentum for Differentially Private Muon
arXiv:2610.02738v1 Announce Type: new Abstract: Differentially private training clips each per-example gradient before adding noise. This clipping is radial for each example, yet unequal clipping factors can distort the relative singular-vector geometry of their average. Muon is…
29 -
Prospective Hindsight: Self-Calibrating Reinforcement Learning via Prediction-Reality Gaps
arXiv:2610.02740v1 Announce Type: new Abstract: Reinforcement learning for long-horizon agents relies on purely retrospective training signals: credit is assigned only after observing environmental consequences, leaving the agent's belief at action time invisible to the…
24 -
Jumping up and down: Denoiser diffusion models for discrete ordinal data
arXiv:2610.02754v1 Announce Type: new Abstract: Diffusion models are highly developed in continuous spaces for image and video domains. Recently, major advances have been made for discrete diffusion models for categorical data, specifically in the language domain. In contrast,…
25 -
A Two-Stage Cascade for Near-Real-Time Forest Anomaly Detection from Sentinel-1 SAR Time Series
arXiv:2610.02763v1 Announce Type: new Abstract: Tropical forest monitoring is essential for global climate stability and biodiversity preservation. To address the urgent need for rapid, reliable detection of forest loss which is essential for timely intervention against illegal…
23 -
A Controlled Audit of Personal AI Memory for Rating Prediction
arXiv:2610.02764v1 Announce Type: new Abstract: In structured rating prediction, does a personal AI use historical item-rating associations, or mainly the user's rating tendencies? We audit this distinction by permuting historical ratings within each user while preserving the…
8 -
Exact Memory-Time Optimization for Prefix-Cached Language Model Serving
arXiv:2610.02766v1 Announce Type: new Abstract: Retaining language-model prefix states trades recomputation against storage time. Optimizing each cached block independently can overcount savings: a resident block is usable only when the required preceding prefix is also…
31 -
No-Free-Graph: Learning When Multimodal Data Should Be Graphified
arXiv:2610.02768v1 Announce Type: new Abstract: Multimodal graph learning has recently emerged as an effective paradigm for in corporating inter-entity relationships into multimodal representations. Existing studies have made substantial progress on how to construct and optimize…
35 -
Nearly Optimal Fixed-Confidence Best-Arm Identification with 1-Bit Feedback
arXiv:2610.02771v1 Announce Type: new Abstract: We study fixed-confidence best-arm identification under strict 1-bit feedback constraints. At each round, the learner selects an arm and a query set, and receives only a single bit indicating whether the sampled reward belongs to…
19 -
LatticeSMC: Where to Spend Inference-Time Compute in Chunked Sequence Generators
arXiv:2610.02774v1 Announce Type: new Abstract: Long-form generators for music, motion and video produce sequences chunk by chunk, with each chunk generated by iterative denoising while rewards are defined over the full sequence. Existing inference-time steering methods…
8 -
Controlling Polar Exposure to Delay Memorization in Diffusion Models
arXiv:2610.02780v1 Announce Type: new Abstract: Diffusion models can reach useful sample quality before copying training examples, but fast optimization can compress this generalization window by accelerating sample-specific fitting. We investigate this effect through update…
5 -
OPD Before RL: Warm-Starting Rubric-Based RL with On-Policy Distillation
arXiv:2610.02781v1 Announce Type: new Abstract: Many useful language-model tasks cannot be evaluated by exact outcome verification. Rubric-based reinforcement learning (RL) addresses this issue by scoring open-ended responses against explicit criteria. However, because the…
14 -
Efficient Memory Crystallization for Graph Learning under Non-Stationary Distribution Shifts
arXiv:2610.02795v1 Announce Type: new Abstract: Deep graph learning models deployed in real-world systems often need to cope with non-stationary environments, where the underlying graph distribution drifts continually over time. Prevailing solutions rely on training auxiliary…
25 -
Muon Learns Facts Better: Understanding the Role of Spectral Orthogonalization
arXiv:2610.02798v1 Announce Type: new Abstract: The Muon optimizer applies spectral orthogonalization to matrix-valued updates and has shown strong performance in large-scale neural network training, yet the mechanisms of this transformation in feature learning remain poorly…
24 -
Gated Slot Attention-2: Two-Sided Associative Memory Correction in Linear Attention
arXiv:2610.02816v1 Announce Type: new Abstract: Linear attention models have emerged as efficient alternatives to standard attention, but effectively managing their fixed-size recurrent memory remains challenging. To improve memory, recent work has explored two distinct…
32 -
Adaptive Spectral-Koopman Dynamics Modeling for Temporal Domain Generalization
arXiv:2610.02822v1 Announce Type: new Abstract: Temporal Domain Generalization (TDG) has emerged to address real-world streaming data with distribution shifts over time. However, existing methods are either prone to overfitting to domain-specific noise in the data space or…
37 -
All Work And No Play Makes Jack a Dull Boy: Understanding and Preventing Catastrophic Strategy Collapse in RLVR
arXiv:2610.02835v1 Announce Type: new Abstract: During post-training of large language models (LLMs) with Reinforcement Learning with Verifiable Rewards (RLVR), GRPO-style algorithms can exhibit severe late-stage collapse. Prompt-based probing reveals that this is not benign…
9 -
To Explore The Strange New World Beyond Data Distribution: System Behavior, Causality Tax, and Non-causal Base Model
arXiv:2610.02839v1 Announce Type: new Abstract: We show that the causality of language models (LMs) may not be necessary nor optimal. This is the case when system behavior (denoted as $S$) is incorporated as a first-principle Bayesian feature. Here, $S$ refers to extra dominant…
12 -
Understanding Enrichment in Reinforcement Learning
arXiv:2610.02846v1 Announce Type: new Abstract: When rewards are sparse, reinforcement learning with verifiable rewards (RLVR) often uses hints or intermediate guidance to generate more successful rollouts. This enrichment biases policy-gradient updates unless corrected via…
6