arXiv — Machine Learning
500 articles archived · Visit source ↗ · RSS
-
-
arXiv — Machine Learning research 9d ago
The Price of Greenwashing: Algorithmic Verification and Market Discipline using Conformal Machine Learning
arXiv:2610.02225v1 Announce Type: new Abstract: While corporate sustainability mandates are expanding, the systemic reliance on self-reported emissions data exposes financial markets to pervasive greenwashing. Current literature relies heavily on subjective ESG ratings or…
37 -
State-Space Unlearning for Non-Stationary Bias in Land Surface Forecasting
arXiv:2610.02248v1 Announce Type: new Abstract: Operational land surface forecasting systems built on Mamba-family Structured State Space Models absorb non-stationary confounding events (unrecorded irrigation booms, dam-operation shifts, sensor recalibrations) into their…
24 -
Nearest-neighbour baselines for fingerprint prediction from MS/MS spectra under different assumptions
arXiv:2610.02249v1 Announce Type: new Abstract: It has recently been shown that nearest-neighbour retrieval provides a strong baseline for molecular fingerprint prediction from MS/MS spectra, with several variants matching or outperforming current deep learning models (Khoo and…
9 -
Rank-Aware Speculative Sampling for Diffusion Draft Trees
arXiv:2610.02251v1 Announce Type: new Abstract: Speculative sampling accelerates diffusion generation by verifying inexpensive draft states in parallel while preserving the target law. Recent tree-based methods allocate the parallel compute budget more effectively than…
7 -
Counterfactual Predictions in Scientific Emulators Without Controlled Experiments
arXiv:2610.02252v1 Announce Type: new Abstract: Many scientific questions require reasoning about what was never observed: What if the conditions, interventions, or history had been different? Models can predict accurately on observed data yet fail on such what-if queries when…
33 -
Approximation Property of Dropout Neural Networks: Sobolev Rates and Confidence Bounds
arXiv:2610.02253v1 Announce Type: new Abstract: The universal approximation property of dropout neural networks does not by itself describe the network size required for an accurate random realization. In this work, we study approximation of the unit ball of…
35 -
Overcoming Challenges of Interpretive Structural Modeling with Large Language Models
arXiv:2610.02254v1 Announce Type: new Abstract: Interpretive Structural Modeling (ISM) is a well-known process for multi-criteria decision making. The success of ISM over other methodologies is its ability to model causal relationships, the binary scale of factors, and resulting…
33 -
MACTS-EM: Multi-Agent Collaborative Time Series Forecasting with Emergent Memory
arXiv:2610.02255v1 Announce Type: new Abstract: Time series forecasting remains a critical challenge across numerous domains. Despite significant advancements, existing approaches struggle with complex phenomena such as regime shifts, cross-domain knowledge transfer, and…
38 -
TRACE: A Reproducible Benchmark for Electricity Price Forecasting with Official Operational Text
arXiv:2610.02256v1 Announce Type: new Abstract: Electricity price forecasting (EPF) supports scheduling, bidding, and risk management in electricity markets, yet existing benchmarks focus mainly on numerical inputs, leaving the forecasting value of forecast-time textual context…
6 -
Parameter-Free Interval-Dynamic Regret under Heavy-Tailed Noise
arXiv:2610.02258v1 Announce Type: new Abstract: We study online convex optimization with one unbiased stochastic subgradient per round and an unknown finite conditional $p$th noise moment, $1<p\le2$. For every fixed interval $I$ of length $n$ and comparator path with…
21 -
From Mathematical to Executable Certificates for Machine Unlearning
arXiv:2610.02268v1 Announce Type: new Abstract: Machine unlearning is needed when data must be removed because of deletion requests, outdated records, or data-quality concerns, while retraining from scratch can be costly. Certified machine unlearning methods provide mathematical…
22 -
CLEAN: Psychometrically Consistent Incremental Cognitive Diagnosis under Concept-Space Expansion via Architectural Isolation
arXiv:2610.02278v1 Announce Type: new Abstract: Cognitive diagnosis (CD) is a fundamental task in intelligent education that profiles learner proficiency over knowledge concepts. In real-world learning platforms, newly added items continually introduce previously unseen…
37 -
MuLoRA: Spectrally Balanced Low-Rank Adaptation for Continual Learning
arXiv:2610.02283v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) provides a parameter-efficient approach to continual learning, but its nominal rank can conceal a loss of effective adaptation capacity. We identify \emph{spectral plasticity collapse}: during sequential…
37 -
Effects of interpulse-interval variation on deep-learning classification of bat vocalizations
arXiv:2610.02284v1 Announce Type: new Abstract: Temporal context may aid automated bat-species classification, but the contribution of specific features remains unclear. We investigated whether variation in the interpulse interval (IPI)-the time between consecutive call…
16 -
Diffusion-Based Synthetic Data Pretraining for Enhancing Activity Recognition
arXiv:2610.02292v1 Announce Type: new Abstract: Human activity recognition (HAR) is increasingly important for healthcare, well-being, and daily monitoring ap- plications, for which detecting alimentary activities such as eating and drinking can provide actionable insight into…
6 -
$\Psi$-Resilience: Model-Free Feature Importance from 1D Topological Signals
arXiv:2610.02299v1 Announce Type: new Abstract: We introduce $\Psi$-Resilience, a model-free feature importance method that derives explanations directly from the data itself via 1D topological signals. Our method constructs a class-disagreement landscape by estimating…
32 -
PowerBench: Measuring Language Model Bias in Power-shifting Requests
arXiv:2610.02303v1 Announce Type: new Abstract: Language models increasingly assist people with power-related requests, so systematic differences in whom they help could shift the distribution of power at scale, or be exploited by users who learn which identities are refused…
16 -
Slow-Fast Multi-Teacher On-Policy Distillation for Capability Preservation
arXiv:2610.02324v1 Announce Type: new Abstract: Foundation multimodal large language models are designed to support a broad spectrum of capabilities across diverse domains. Multi-teacher on-policy distillation (MOPD) provides an effective framework for consolidating…
15 -
Drive vs. Decay: On the Training Dynamics of Joint-Embedding Predictive Architectures
arXiv:2610.02344v1 Announce Type: new Abstract: Joint-Embedding Predictive Architectures (JEPAs) are prone to representation collapse, typically mitigated through empirical heuristics. We develop an early-training stability theory that unifies these heuristics. Linearising the…
21 -
Mitigating Convergence Collapse in Fixed-Target Anomaly Detectors via Kernel-Anchored Locality Regularization
arXiv:2610.02345v1 Announce Type: new Abstract: A family of tabular anomaly detectors trains a neural map toward a fixed target under squared-error loss and scores anomalies by the test-time residual; contraction matching, one-step rectified flow, and reconstruction autoencoders…
35 -
From Behavior to Provenance: Attributing Tabular Foundation Models to Synthetic Pretraining Data
arXiv:2610.02347v1 Announce Type: new Abstract: Training-data attribution aims to identify which training examples shape model behavior, yet validating such claims is difficult because causal training influence is rarely observable. We argue that controlled synthetic pretraining…
6 -
Does Every User Need a Private LoRA? Decoupling Personalization from Per-User Adaptation
arXiv:2610.02353v1 Announce Type: new Abstract: Personalized large language models often require a complete adaptation state for each user. However, this paradigm scales poorly as the user population grows. We revisit this design through the lens of personalization capacity…
11 -
Why Does Adaptive Batching Help LLM Pretraining? A Perspective from Unbounded Variance
arXiv:2610.02355v1 Announce Type: new Abstract: Increasing the batch size during training is a common practice in large language model (LLM) pretraining, yet the theoretical justification behind its success is not well understood. Analyses of stochastic optimization often assume…
37 -
Lexicographic Multi-Objective On-Policy Distillation
arXiv:2610.02359v1 Announce Type: new Abstract: Reinforcement learning from verifiable rewards (RLVR) usually optimizes answer correctness, yet useful language-model behavior also requires high-quality reasoning and concise responses. Existing multi-reward post-training methods…
25 -
ArrivalBench: Agent-Generated Data Pipelines Are Correct Once and Wrong Under Time
arXiv:2610.02363v1 Announce Type: new Abstract: Benchmarks for agent-generated data work grade a pipeline by running it once against a fixed snapshot. ArrivalBench instead re-executes the pipeline an agent leaves behind under adversarial but replayable delivery schedules (late,…
34 -
Co-design Gym: A Unified Benchmark for Embodiment-Policy Co-optimization
arXiv:2610.02366v1 Announce Type: new Abstract: Finding an optimal behaviour policy within a given environment is a widely studied problem in domains as diverse as games, robotics, energy infrastructure, communication networks, and multi-agent systems. Numerous benchmarks have…
9 -
Latent-MOPD: Latent Multi-Teacher On-Policy Distillation
arXiv:2610.02381v1 Announce Type: new Abstract: On-policy distillation (OPD) trains a student on the responses it generates. Existing LLM multi-teacher OPD transfers what specialists predict through their output distributions. We introduce Latent-MOPD, to our knowledge the first…
6 -
The Surprising Effectiveness of Shared Memory in Looped Transformers
arXiv:2610.02383v1 Announce Type: new Abstract: Looped Transformers apply the same layers several times per token, adding compute to improve quality without more parameters. Each recursion, however, writes its own key-value cache, so memory still grows with compute.…
36 -
Hesitation Has a Geometry: Entropy-Trained Hyperbolic Probes for Sparse Activation Steering
arXiv:2610.02391v1 Announce Type: new Abstract: When a large language model solves a mathematical problem, its reasoning is largely hierarchical, and the solution often branches at a few tokens where the next-token entropy is high. Such tree-like structure embeds in hyperbolic…
7 -
Inherit-MAS: Test-Time Evolution of Multi-Agent Systems through Workflow and Execution Inheritance
arXiv:2610.02396v1 Announce Type: new Abstract: Multi-agent systems (MAS) built from large language models coordinate specialized agents to tackle complex tasks, but effective workflows are difficult to design in advance. Test-time evolution refines workflows using execution…
34 -
-
VisAudit: Evaluating Multimodal Agents for Visual Diagnosis and Repair
arXiv:2610.02399v1 Announce Type: new Abstract: Multimodal agents are increasingly used for data visualization tasks but remain limited in autonomous review. Unlike humans, they may fail to recognize when a visualization is incorrect, determine what to change, repair it without…
15 -
Trained Agentic Context Management
arXiv:2610.02404v1 Announce Type: new Abstract: We study long context language models. Instead of training long context natively, or designing a long context harness, we train a model over the simplest possible harness: a tool to call itself with any specified prompt and a tool…
7 -
Efficient Neural Field Learning via Adaptive Coverage and Focused Sampling
arXiv:2610.02410v1 Announce Type: new Abstract: Implicit neural representations (INRs) provide a flexible framework for modeling high-dimensional continuous fields, but their training is often inefficient due to uniform subsampling that ignores spatial heterogeneity. Existing…
8 -
Prompted to Discriminate: Generalizing Malicious-Input Probes in the Wild
arXiv:2610.02413v1 Announce Type: new Abstract: LLM agents increasingly rely on activation probes as runtime monitors for prompt injection, jailbreaks, and unsafe requests, reading the model's own hidden state to catch a harmful input before the agent acts on it. A cheap,…
10 -
The AI Theorist reveals excitonic structure in $\alpha$-RuCl$_3$
arXiv:2610.02417v1 Announce Type: new Abstract: Advances in experimental instrumentation and automation generate increasingly rich datasets, but turning experimental observations into microscopic understanding remains a bottleneck in scientific discovery. To accelerate this…
17 -
Geometry-Aware Time Reparameterization for Flow-Map Distillation
arXiv:2610.02427v1 Announce Type: new Abstract: Flow-map distillation enables one- and few-step generation by learning finite-time transitions of a pretrained generative ODE. We investigate whether changing the teacher's time parameterization can make these transitions easier to…
29 -
CRISP: A Framework for Clause-Reconstructed Interpretable NeuroSymbolic Propositions
arXiv:2610.02431v1 Announce Type: new Abstract: Deep neural networks achieve high accuracy through layered numerical transformations, yet their decisions remain difficult to audit because decision evidence is encoded in hidden activations rather than explicit rules. This paper…
10 -
Are you Synthesizing or Recalling? Evaluating LLMs on Algorithmic Code Retrieval
arXiv:2610.02438v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated strong performance in code generation, where success depends on both recalling relevant algorithmic knowledge and reasoning about how to apply it. However, existing LLM pipelines are…
17 -
A Generative Model of Complex Networks Using Graphons and Neural Inverse Operators
arXiv:2610.02439v1 Announce Type: new Abstract: Generative graph models are central to understanding and simulating complex networks. However, existing approaches have complementary strengths and limitations. Mechanistic models offer interpretability but rely on…
10 -
Bandits via Additive Quantized Representations
arXiv:2610.02440v1 Announce Type: new Abstract: Contextual bandits require balancing nonlinear reward modeling with online efficiency. Tree ensembles and neural methods capture nonlinearities but require periodic retraining and large replay buffers. Linear models update…
23 -
AI-driven Thermal-aware Data Center Capacity Planning
arXiv:2610.02442v1 Announce Type: new Abstract: The emerging of large language models (LLMs) has posed significant challenges to the thermal management of data center. Intense GPU computation for LLMs results in localized hotspots. Moreover, spiking thermal loads during training…
6 -
A Composable AI-Accelerated Iterative Solver for 3D-IC Thermal Modeling
arXiv:2610.02461v1 Announce Type: new Abstract: Accurate thermal analysis of heterogeneous 2.5D/3D-IC packages is essential yet computationally prohibitive. A single full-package FEM simulation can take hours, while AI-based surrogates treat the entire stack as a monolithic…
34 -
Capability Scaling-Down Laws for LLM Compression
arXiv:2610.02462v1 Announce Type: new Abstract: LLM compression reduces inference costs and memory requirements, but selecting a method and configuration remains largely empirical because comparable resource reductions can produce different capability losses. We systematically…
33 -
Threshold-Aware Conformal Routing
arXiv:2610.02487v1 Announce Type: new Abstract: High-fidelity simulations are essential to scientific and engineering design, but can be expensive to run repeatedly. Learned surrogates offer a faster alternative, yet their higher errors may alter downstream decisions. This…
30 -
Harnessing LLMs as Agents: What Does It Cost?
arXiv:2610.02488v1 Announce Type: new Abstract: Language-model agents increasingly rely on harnesses that manage bounded context, persistent memory, tools, verification, and repeated execution, yet existing notions of model capability do not quantify the computational resources…
20 -
LiteEMG-FM: An Efficient and Deployable Foundation Model for Robust EMG Sensing
arXiv:2610.02497v1 Announce Type: new Abstract: Electromyography (EMG) signals vary substantially across individuals, body regions, recording sessions, and sensing hardware, limiting the generalization of models for assistive devices and human-computer interaction. Existing…
26 -
Multi-Fidelity Policy Gradients Stabilize Data-Scarce Reinforcement Learning
arXiv:2610.02505v1 Announce Type: new Abstract: Policy gradient methods for on-policy reinforcement learning (RL) can become unstable when expensive, scarce target-domain data yield noisy gradient estimates. We address this challenge by complementing limited high-fidelity (HF)…
14 -
Post-Training Quantization of Autoregressive Weather Models
arXiv:2610.02511v1 Announce Type: new Abstract: Advancements in high-resolution numerical weather prediction (NWP) and data assimilation (DA) have shaped the developments in deep learning (DL) architectures emulating atmospheric dynamics. Emulators for weather forecasting…
36