arXiv — NLP / Computation & Language
500 articles archived · Visit source ↗ · RSS
-
arXiv — NLP / Computation & Language research 7d ago
DirectSpeech2LLM: A Simple End-to-End Framework to Mitigate Prompt Overfitting in Speech-LLMs
arXiv:2610.08085v1 Announce Type: new Abstract: Speech-LLMs often exhibit prompt overfitting, where models solely trained on automatic speech recognition (ASR) instruction fail to generalize to new instructions such as speech translation and continue to behave primarily as ASR…
33 -
SAGE: Semantic Anchor-Guided Evolution for Grounded Medical QA Data Synthesis
arXiv:2610.08093v1 Announce Type: new Abstract: Developing reliable models for clinical tasks, such as Medical Question Answering (QA), is severely constrained by the limited availability of high-quality, expert-annotated training data. This challenge is exacerbated by stringent…
6 -
Penalty-Framed No-Valid-Option MCQA: Analyzing LLM Abstention under Invalid Choices
arXiv:2610.08153v1 Announce Type: new Abstract: Multiple-choice question answering (MCQA) is commonly used to evaluate large language models under the assumption that one of the provided options is correct, typically using answer-selection accuracy. However, in real deployments,…
11 -
Making COMET Comparable Across Scripts: Diagnosis and Correction of Tokeniser-Induced Script Bias in Indic MT Evaluation
arXiv:2610.08159v1 Announce Type: new Abstract: COMET reports translation quality as a single number, and that number is routinely compared across target languages written in different scripts. Such a comparison assumes Script Invariance: the score should not depend on the…
28 -
STRUCTURALCOST: A controlled reading time dataset for modeling human sentence processing difficulty
arXiv:2610.08208v1 Announce Type: new Abstract: We introduce STRUCTURALCOST, a self-paced reading dataset of 475 participants and 40,800 observations isolating the processing cost of long-distance subject-verb dependency resolution. We replicate a low-powered psycholinguistic…
31 -
Memory Depth and Reconstructed Context Width: A Controlled Evaluation of Hierarchical Retrieval
arXiv:2610.08300v1 Announce Type: new Abstract: Long-term conversational memory is becoming an integral component of modern LLM systems. Proposed architectures group records by topics and events, construct hierarchies and graphs, and connect facts through causal and temporal…
25 -
Language Unalignability: Why Some Concepts Resist Cross-Cultural Benchmark Evaluation
arXiv:2610.08303v1 Announce Type: new Abstract: Current evaluation of multilingual Large Language Models (LLMs) rests on an implicit Translation-Isomorphism Assumption (TIA): that semantic structures across languages are congruent and mutually mappable without loss of…
13 -
Foresight-over-Graph: Reasoning Beyond Local Horizons for Knowledge Base Question Answering
arXiv:2610.08388v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated strong capabilities in question answering, yet they still frequently suffer from hallucinations on knowledge-intensive tasks. Knowledge graphs (KGs) provide LLMs with structured,…
27 -
Knowing When Not to Answer: Cross-Domain and Multi-Turn Generalization of Latent Underspecification Signals
arXiv:2610.08413v1 Announce Type: new Abstract: Large language models routinely answer questions that cannot be answered from the information given, and in dialogue they answer before enough has been said. Unanswerability is linearly decodable from hidden states, but it is…
8 -
Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability
arXiv:2610.08448v1 Announce Type: new Abstract: On-Policy Distillation (OPD) trains a student on its own generations using teacher feedback. With different tokenizers, comparing teacher and student predictions requires alignment at both sequence and vocabulary levels. In this…
26 -
Agentic AutoRAG: RAG Pipeline Optimization through Reasoning-Driven Agents
arXiv:2610.08452v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) is a widely used approach for grounding large language models (LLMs) in external knowledge. However, configuring a pipeline is an expensive hyperparameter optimization problem over many…
21 -
UNREAL: Unifying Retrieval and Long-Context with a Single Model
arXiv:2610.08463v1 Announce Type: new Abstract: Long-context inference and Retrieval-Augmented Generation (RAG) handle evidence selection at vastly different scales, from a single long prompt to an entire corpus. We ask whether a single model-internal mechanism can select…
19 -
Language-model ratings of depression reflect the rater more than the patient
arXiv:2610.08501v1 Announce Type: new Abstract: Depression has no diagnostic blood test. Language models promise tireless, consistent assessment, but can accurate raters disagree about individuals? We pre-registered 880 language-model raters, crossing 11 open models with…
17 -
Wiki-Talkie: Multilingual Benchmarking of Persona-Based Agents on Real-World Discussions
arXiv:2610.08513v1 Announce Type: new Abstract: LLMs are increasingly deployed as autonomous agents in social environments, making it critical to study their ability to faithfully simulate human interactions. Central to this is grounding agents in realistic user personas, yet…
32 -
How High Is 0.6? Floors, Ceilings, and Headroom in Interpretability Probing
arXiv:2610.08544v1 Announce Type: new Abstract: Probes are the workhorse of interpretability. If a model's hidden states predict a variable, the model is said to represent it. But a probe score has no fixed meaning. An $R^2$ of 0.6 may only reflect what the input already gives…
30 -
Latent space bias directions in LLMs capture confidence, not fairness
arXiv:2610.08559v1 Announce Type: new Abstract: Activation steering has gained popularity as a lightweight inference-time debiasing technique for large language models. However, prior work reports that steering vectors generalise poorly, with unintended effects on model…
12 -
Incidental information contaminates patient notes and disrupts clinical reasoning in large language models
arXiv:2610.08585v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly relied upon to support ambient documentation and clinical reasoning. Here we examine the impact of a failure mode shared between these two applications by assessing their sensitivity to…
28 -
Generative AI translations in high-stakes emergency messaging
arXiv:2610.08601v1 Announce Type: new Abstract: Emergency messaging such as extreme-weather reports and earthquake instructions can involve high stakes, to the extent that translation errors can lead to tragic consequences. The use of machine translation or generative artificial…
27 -
InterCorrect: Intersection-Aware Correction of Demographic Model Merging for Fair ASR
arXiv:2610.08604v1 Announce Type: new Abstract: Automatic Speech Recognition (ASR) systems often show uneven performance across demographic groups, and errors can be especially difficult to address for speakers belonging to multiple demographic groups. This work studies…
5 -
Towards In-Parameter Memory Augmentation for Large Language Models
arXiv:2610.08630v1 Announce Type: new Abstract: Recently Large Language Models (LLMs) and LLM-based agents increasingly need to incorporate knowledge acquired after pretraining, e.g., domain facts, user preferences, documents, and interaction experience. In-context learning…
31 -
Evidence-Bound Reasoning: Neuro-Semantic Verification of Biomedical AI in Glioblastoma Radiogenomics
arXiv:2610.08660v1 Announce Type: new Abstract: Background: Biomedical AI can generate plausible explanations without reliably verifying whether each statement is supported by patient-specific evidence. We developed a neuro-semantic verification framework that converts radiomic…
14 -
Same-Number Citation Swaps: Stress-Testing Jev as a Financial Evidence Judge
arXiv:2610.08675v1 Announce Type: new Abstract: Financial reports repeat values across periods, metrics and accounting lines, allowing an LLM-generated calculation to be numerically correct while citing the wrong financial role. We evaluate what probabilistic evidence…
11 -
Agreement Is Not Validity: Cross-Model LLM Consensus in Diagnosing Student Failure Modes in K-12 Math Tutoring Dialogue
arXiv:2610.08703v1 Announce Type: new Abstract: In K-12 mathematics tutoring, student-tutor dialogue provides rich evidence of learners' problem-solving processes and sources of difficulty. Learning analytics research increasingly relies on large language models (LLMs) to…
13 -
When Forgetting is not Catastrophic: On the Mechanics of Spurious Forgetting
arXiv:2610.08718v1 Announce Type: new Abstract: Knowledge that a language model appears to forget during finetuning often remains stored and can be recovered, a phenomenon called spurious forgetting. Finetuning on new facts can even produce forgetting that undoes itself: recall…
4 -
Holdout Best-of-N: Unbiased Evaluation and Its Cost
arXiv:2610.08719v1 Announce Type: new Abstract: Reusing the scores that select a Best-of-$N$ winner can overstate its expected reward. We study evaluation from a fixed matrix of $K$ independent scores per candidate for a policy that selects using $J$ fresh scores. A single…
21 -
Denoising Hierarchical Representations: Joint Continuous Diffusion for Language Modeling
arXiv:2610.08738v1 Announce Type: new Abstract: Diffusion Language Models (DLMs) hold the promise of order-agnostic, parallel text generation. Recently, continuous diffusion and flow matching models have seen substantial gains, driven by carefully crafted token representations…
14 -
The Missing Minimal Pair: Stereotype Evaluation in LLMs
arXiv:2610.08747v1 Announce Type: new Abstract: A common approach to measuring bias in Large Language Models is to compare the log-likelihoods of two contrastive stereotype sentences. We argue that such single-pair comparisons are often unreliable: simply rewriting the same…
35 -
AdvSim2Real : Training Web Agents Against Adaptive Prompt Injection in a Web World Model
arXiv:2610.08773v1 Announce Type: new Abstract: Web agents complete user requests by reading and acting on pages that third parties write, so an instruction planted on a page can redirect the agent away from the user's goal. The agent cannot simply ignore the page, because the…
8 -
IdeaAnchor: Teaching LLMs to Turn Literature into Research Ideas
arXiv:2610.08781v1 Announce Type: new Abstract: Scientific research often begins by synthesizing ideas from a set of related papers to identify gaps and formulate new directions. However, training language models to perform this form of literature-grounded ideation remains…
27 -
Pronunciation Editing for Finnish Speech using Phonetic Posteriorgrams
arXiv:2507.02115v3 Announce Type: cross Abstract: Synthesizing second-language (L2) speech is potentially highly valued for L2 language learning experience and feedback. However, due to the lack of L2 speech synthesis datasets, it is difficult to synthesize L2 speech for…
14 -
Nord-Parl-TTS: Finnish and Swedish TTS Dataset from Parliament Speech
arXiv:2509.17988v2 Announce Type: cross Abstract: Text-to-speech (TTS) development is limited by scarcity of high-quality, publicly available speech data for most languages outside a few high-resource languages. We present Nord-Parl-TTS, an open TTS dataset for Finnish and…
15 -
When Does External Guidance Help LLM Reasoning? A Bias-Variance Theory of Guidance-Augmented GRPO
arXiv:2610.06861v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) has become the dominant paradigm for eliciting multi-step reasoning in large language models, and a recent wave of methods (LUFFY, ExPO, PAPO, TAPO) further augments RL with…
4 -
AegisFlow: A Multi-Agent Agentic AI Framework for Autonomous Remediation and Self-Healing in Fragile Data Ecosystems
arXiv:2610.06971v1 Announce Type: cross Abstract: Traditional data pipelines are notoriously brittle, often failing due to upstream schema drift, API contract changes, or website DOM modifications. Present observability tools only raise alerts but for human engineers, resulting…
23 -
Mask-Guided KV Cache Eviction in Block Diffusion Language Models
arXiv:2610.06996v1 Announce Type: cross Abstract: Block diffusion language models keep a large key-value (KV) cache throughout generation and attend to it at every denoising step, limiting both memory capacity and generation speed. Reducing these costs requires deciding which…
35 -
Beyond Refusal Patterns: Safe-Role Internalization for Robust and Generalizable LLM Safety Alignment
arXiv:2610.07023v1 Announce Type: cross Abstract: Large Language Models (LLMs) have achieved remarkable capabilities but remain vulnerable to jailbreak attacks that elicit harmful or unsafe outputs. Existing safety alignment approaches, including Supervised Fine-Tuning (SFT) and…
18 -
GIVE-KWS: Gated Injection of Visual Evidence for Noise-Robust Query-by-Example Keyword Spotting
arXiv:2610.07046v1 Announce Type: cross Abstract: Visual speech promises noise-robust keyword spotting, yet a visual stream is not necessarily used. On a tri-modal query-by-example keyword spotting (QbyE-KWS) benchmark, we find that a system with a task-trained visual encoder…
23 -
SEAL: Mixture-Closed Additive Reconstruction and Refinement-Aware Expert Routing for Efficient Speech Separation
arXiv:2610.07047v1 Announce Type: cross Abstract: Compact time-frequency separators that mask the mixture and refine through a shared cell face two limits. First, a bounded multiplicative mask only scales a mixture bin, so where overlapping components cancel, the estimate stays…
35 -
Learning to Simulate Individuals from Macro Social Signals
arXiv:2610.07062v1 Announce Type: cross Abstract: Large language models are increasingly used to simulate how individuals respond to new situations, yet the behavioral reasoning behind these responses is either inherited from pretraining or learned from individual-level…
25 -
Smart Content Ingestion for Generative AI Workloads
arXiv:2610.07091v1 Announce Type: cross Abstract: The evolution of machine learning has progressively changed where intelligence resides in an AI system. In conventional machine learning the task, data representation, labels and model architecture were tightly coupled, so data…
38 -
Jailbreaking Open-Weight LLMs via Random Embedding Perturbations
arXiv:2610.07125v1 Announce Type: cross Abstract: While open-weight models have enjoyed steady progress in capabilities and wide adoption across multiple domains, their safety remains an important concern. One key feature is the ability to refuse or deflect harmful, malicious,…
38 -
A theory of platonic representations in language models
arXiv:2610.07168v1 Announce Type: cross Abstract: Representations of translated sentences are similar in the inner layers of multilingual language models -- an observation connected to the platonic representation hypothesis, yet unexplained theoretically. We provide an…
20 -
CLM-as-a-Judge: Evaluating an Open Contrastive Decision Model on Public Judge Benchmarks
arXiv:2610.07177v1 Announce Type: cross Abstract: An open contrastive decision model is near chance as a judge on the hard public benchmarks: Contrastive-LM/CLM-v0.1-8B scores between 0.351 (best- of-four, chance 0.250) and 0.593 (pairwise, chance 0.500), is statistically…
5 -
Learning Scientific Exploration from Human Research Decision Trajectories
arXiv:2610.07184v1 Announce Type: cross Abstract: A key challenge in building AI systems for scientific research is enabling $\textit{scientific exploration}$: the systematic process of investigating unknown phenomena or ideas to gain new knowledge through sequences of research…
21 -
Responsible Institutional Analytics: Interpreting Bias with AI Support
arXiv:2610.07205v1 Announce Type: cross Abstract: Institutional Analytics (IA) dashboards inform decision-making in higher education, yet data limitations, constraints in analytical techniques, and missing contextual information often affect their interpretation. To support more…
32 -
Forecasting the Growth of Social Media Information Cascades: Towards Human-in-the-Loop Misinformation Triage
arXiv:2610.07209v1 Announce Type: cross Abstract: Limited review teams must identify which emerging claims are likely to keep growing before their eventual reach is known. We center early misinformation triage on this continuation-forecasting problem: predicting subsequent…
18 -
Minimal Witness Reinforcement Learning
arXiv:2610.07226v1 Announce Type: cross Abstract: ``What are the irreducible conditions that are sufficient to produce an outcome?'' is one of the most common questions that recur across computation and science. Its answers, the minimal sufficient witnesses, are what we mean by…
8 -
Lineage-Aware Memory Governance: A Derivation-Gated Framework for Privacy-Preserving Column-Level Access Control in Enterprise AI Agents
arXiv:2610.07258v1 Announce Type: cross Abstract: Enterprise AI agents that share a memory store face two unaddressed risks: sensitive data can leak through legitimately computed results the requester could not derive, and departments can silently compute a same-named key…
26 -
SharedKV-BT: Node-Local Typed Decisions for Behavior-Tree Agents
arXiv:2610.07327v1 Announce Type: cross Abstract: Agent tasks require sequences of interdependent decisions. Autoregressive models support more flexible decision interfaces than conventional classifiers but incur the latency of token-by-token generation. Recent shared-prefix…
30 -
Structuring MoE Expert Selection for Agentic Reinforcement Learning
arXiv:2610.07332v1 Announce Type: cross Abstract: Long-horizon LLM agents are frequently implemented using sparse mixture-of-experts (MoE) models, yet the co-design of agentic behavior and MoE structures remains underexplored. In this work, we comprehensively study the…
22 -
Logbook: Extremely Long-form Audio Event Understanding
arXiv:2610.07338v1 Announce Type: cross Abstract: Audio benchmarks are built around short, pre-segmented clips, limiting model design to brief inputs or fixed vocabularies. To close this gap, we introduce Logbook, a benchmark for hour-scale audio understanding, with recordings…
16