arXiv — NLP / Computation & Language
500 articles archived · Visit source ↗ · RSS
-
arXiv — NLP / Computation & Language research 6d ago
ExperienceIndex: Artifact-Grounded Memory
arXiv:2610.10091v1 Announce Type: new Abstract: Knowledge-intensive tasks require answering many questions by reasoning about a shared corpus of artifacts (e.g., court cases, or scientific literature). As humans interact with these corpora, they naturally accumulate experiential…
38 -
I would rather quit NLP than read another paper like this: The rise of antithesis in NLP papers
arXiv:2610.10092v1 Announce Type: new Abstract: For better or worse, LLMs are by now used routinely for scientific writing.\footnote{This paper is no exception; we did use AI to assist with writing some of the sections (see Acknowledgments).} Many have noticed that recent models…
7 -
Mechanics of Long-Context Hybrid Models Part 1.1: From Hybrid Attention to Hybrid Position
arXiv:2610.10114v1 Announce Type: new Abstract: The architectural design of Large Language Models (LLMs) is shifting from traditional full-attention-only models to hybrid models, which combine different attention modules to improve long-context efficiency and performance in…
18 -
LLM4Impact: Integrating Heterogeneous Information for Scientific Impact Prediction
arXiv:2610.10138v1 Announce Type: new Abstract: Predicting the future impact of a newly published paper is challenging because it must be inferred from heterogeneous evidence available at publication time. Existing approaches often rely on a single source of information or…
26 -
InterView-C: A Synchronized Multimodal Corpus of VR Avatar-Mediated Survey Interviews
arXiv:2610.10145v1 Announce Type: new Abstract: We present InterView-C, a German multimodal corpus of 27 survey interviews conducted entirely in virtual reality, with both interlocutors represented by avatars. The corpus aligns spoken interaction with synchronized behavioral…
29 -
HySPE: Positional Encoding via Symplectic Dual Shears
arXiv:2610.10154v1 Announce Type: new Abstract: We introduce Hyperbolic Symplectic Positional Encoding (HySPE), grounding positional attention in non-compact symplectic transformations. While canonical Rotary Position Embedding (RoPE) parameterizes the compact, elliptic branch…
35 -
Beyond Outcome Rewards: Constructing and Assigning Retrieval Credit for Search Agents
arXiv:2610.10179v1 Announce Type: new Abstract: Search agents enable Large Language Models (LLMs) to iteratively retrieve and use information for complex multi-hop questions. Reinforcement Learning with Verifiable Rewards (RLVR) offers a promising approach for post-training such…
33 -
LLM Persuasion Is in the Eye of the Evaluation
arXiv:2610.10232v1 Announce Type: new Abstract: Large language models (LLMs) have already been shown to match or exceed human experts in persuasion. While their persuasive capabilities hold promise for beneficial uses such as education and health communication, they can also be…
9 -
Nobody Truly Agrees on Sentiment: Humans, Bespoke Tools, and LLMs Struggle with Social Media Texts
arXiv:2610.10318v1 Announce Type: new Abstract: Social media is a rich source of real-time public sentiment, but widely used sentiment analysis tools are often applied without understanding their limitations. In this study, we evaluate the inter-rater reliability of three…
6 -
Learning to Act with Task Progress: Distilling Small Agents from Compact Teacher Supervision
arXiv:2610.10332v1 Announce Type: new Abstract: Learning from large-model demonstrations offers a way to train small agents that can complete recurring tasks without calling a large model at every step. A central design choice is what to retain from teacher trajectories that…
23 -
Document-Level Text Simplification in Estonian Using Large Language Models
arXiv:2610.10378v1 Announce Type: new Abstract: Document-level text simplification involves transformations that go beyond sentence-internal edits, addressing discourse coherence, anaphora resolution, and cross-paragraph consistency. Despite advances in sentence-level…
12 -
CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolution
arXiv:2610.10426v1 Announce Type: new Abstract: Terminal-agent capability depends jointly on model weights and the runtime harness that formats prompts, binds tools, and handles error recovery. Existing harness-model co-evolution approaches improve both components, yet often…
25 -
PHRBench: A Behavioral Evaluation of Post-Hallucination Reasoning in LLMs
arXiv:2610.10455v1 Announce Type: new Abstract: Hallucinated information can propagate through multi-stage LLM systems and become part of the context for subsequent reasoning. Existing studies of post-hallucination reasoning (PHR) mainly characterize changes in final outcomes…
19 -
Your Prompt Should Do More: Effects of Retrieval Instructions in Embedding Models
arXiv:2610.10508v1 Announce Type: new Abstract: Prompted embedding models have recently received increasing attention, particularly for retrieval, where detailed retrieval instructions are provided as part of the retrieval prompt. Several new datasets and studies have examined…
32 -
EngramEdit: Decoupled Knowledge Updates in LLMs through Conditional Memory
arXiv:2610.10533v1 Announce Type: new Abstract: Conditional memory architectures such as DeepSeek Engram use input n-grams to look up learned embeddings, expanding the capacity of large language models (LLMs) with limited additional computation. Beyond model scaling, this…
29 -
EmphTTS: an emphasis-control TTS with reinforcement learning
arXiv:2609.27599v2 Announce Type: cross Abstract: Generating controllable and human-like emphasis remains an open challenge in text-to-speech, even when explicit emphasis control signals are provided in the text input, limiting the communicative accuracy of synthetic speech in…
15 -
Route-Verify-Vote: Procedure-Conditioned Self-Consistency for Mixed-Domain Reasoning
arXiv:2610.08814v1 Announce Type: cross Abstract: Compositional generalization remains challenging when language models must combine familiar reasoning operations in unfamiliar ways. The Scenario-Based Commonsense Reasoning Evaluation (SCoRE) 2026 tests this ability on three…
9 -
Just for FUNS: LLM-Guided Spatio-Temporal Graph Node Generation for Forecasting Unobserved Node States
arXiv:2610.08818v1 Announce Type: cross Abstract: Spatio-temporal forecasting is a cornerstone of logistics, urban planning, and intelligent transportation systems. However, constrained by deployment costs and maintenance resources, sensor networks often lack comprehensive…
7 -
Is Word Error Rate Enough? Rethinking Privacy Evaluation in Speech with Entity-Aware Metrics
arXiv:2610.08831v1 Announce Type: cross Abstract: As the use of smart devices continues to increase, their potential to capture sensitive speech content raises growing privacy concerns. It is therefore critical to develop techniques that prevent information leakage while…
31 -
FinVector-Market-4B: A Controlled Study of LoRA Adaptation for Structured Financial Tasks
arXiv:2610.08882v1 Announce Type: cross Abstract: FinVector-Market-4B adapts Qwen/Qwen3.5-4B with rank-16 LoRA on a 22,000-example corpus for structured financial tasks. We evaluate the base and adapted models on the same 600-example benchmark under implicit and explicit…
8 -
On KL-Regularized Policy Optimization
arXiv:2610.08963v1 Announce Type: cross Abstract: Asynchronous reinforcement learning (RL) for large language model (LLM) agents trains one policy on trajectories generated by another: rollouts come from stale checkpoints, and the inference engine's probabilities differ from the…
4 -
Phoneme-Guided Initialization for LLM-based Speech Recognition
arXiv:2610.08994v1 Announce Type: cross Abstract: Speech large language models (speech LLMs) perform well on automatic speech recognition (ASR) when sufficient paired speech-text data is available, but their performance degrades in low-resource settings. A cascaded pipeline that…
24 -
How Fragile Is On-Device Language Model Safety? Localizing Safety-Critical Parameters for Sparse Fault Analysis
arXiv:2610.09000v1 Announce Type: cross Abstract: As small language models (SLMs) are increasingly deployed on resource-constrained and on-device platforms, including as components of agentic systems, the integrity of locally stored model parameters becomes an important safety…
19 -
BEACON-SP: Ontology-Grounded GraphRAG Framework for Clinical Suicide Risk Assessment
arXiv:2610.09026v1 Announce Type: cross Abstract: We present BEACON-SP, an ontology-grounded Graph Retrieval-Augmented Generation (GraphRAG) framework for clinician-facing decision support in behavioral health settings such as suicide prevention, where effective assessment…
18 -
Multi-Label Topic Assignment via LLM Distillation: A Comparative Analysis of Generative vs. Discriminative Student Models
arXiv:2610.09063v1 Announce Type: cross Abstract: Multi-label topic assignment for user-generated content (UGC) -- including product reviews and buyer-seller conversations -- poses unique scalability challenges in large-scale e-commerce due to informal language, extreme label…
21 -
Talking with Language Models
arXiv:2610.09064v1 Announce Type: cross Abstract: When we interact with large language models (LLMs), are we having a conversation? They are designed to invite us to treat them as intelligent interlocutors who remember, act, and make commitments. But appearances deceive. We…
33 -
Large-scale Repository Engineering via Agent-Native Reusable Code Primitives
arXiv:2610.09079v1 Announce Type: cross Abstract: Large language models equipped with development environments have moved code generation toward repository-scale construction, yet building complete repositories remains difficult because interacting modules, interfaces,…
26 -
Constraint Tree Exploration for Learning from Language Feedback
arXiv:2610.09107v1 Announce Type: cross Abstract: Natural-language feedback in interactive learning often explains why an action failed by pointing to violated requirements. Misinterpreting this feedback can lead an agent to rule out valid solutions. We study this setting by…
26 -
From Uncertainty to Action: Learning to Steer LLM Agents
arXiv:2610.09115v1 Announce Type: cross Abstract: Steering an LLM agent means deciding whether to correct it, at which step, and with which mechanism. Uncertainty is often used to decide when to correct an agent, but whether it can guide these decisions remains unclear. We steer…
14 -
Noise Your Prompt: Noising Conditioning Tokens in Continuous Diffusion Language Models
arXiv:2610.09145v1 Announce Type: cross Abstract: We revisit a standard accepted practice in the continuous diffusion language model literature of fixing conditioning prompt tokens clean during training. We make a very simple modification: also noise the conditioning prompt…
9 -
LayerRoPE: Dynamic Depth-wise Magnitude & Angular Superposition
arXiv:2610.09179v1 Announce Type: cross Abstract: As data propagates through a Transformer, the norm of its hidden states grows by orders of magnitude with depth, a phenomenon framed as 'curse of depth' and nearly universally treated as a pathology to be suppressed. We take the…
35 -
Bookkeeping, Composition, or Unreachable Gold? Reading MemoryAgentBench's Conflict-Resolution Scores Against a Frozen Last-Write Resolver
arXiv:2610.09193v1 Announce Type: cross Abstract: MemoryAgentBench's Conflict Resolution split is read as measuring "selective forgetting". We execute the benchmark's own rule - the newest statement about a fact wins - as a zero-learning resolver frozen on one of the four fact…
20 -
Few Bits, One Law: Toward W2A4KV2
arXiv:2610.09202v1 Announce Type: cross Abstract: Extreme low-bit LLM compression is most challenging when weights, activations, and KV caches are quantized together: their distributions differ, and quantization errors interact throughout the network. We introduce CanonQ, a…
22 -
Quantize by Drift: Label-Free Mixed-Precision Post-Training Quantization for Text Embedders
arXiv:2610.09227v1 Announce Type: cross Abstract: Mixed-precision post-training quantization needs a per-module sensitivity signal; for a text embedder the obvious one -- the retrieval quality a module costs when quantized -- needs relevance labels that deployments rarely have.…
8 -
Trajectory Abstraction for the Science of Language Agent Behavior
arXiv:2610.09237v1 Announce Type: cross Abstract: Scientific studies of language agents need behavioral variables that support hypotheses across tasks and models. We formulate this research problem as learning and testing a hierarchy of trajectory abstractions. A concrete…
20 -
Adversarial Images Hijack Web Agents from Visual Grounding to Browser Execution
arXiv:2610.09240v1 Announce Type: cross Abstract: Modern web agents built on large vision-language models process webpages, select relevant UI elements, and translate model outputs into browser actions. Existing visual red-teaming approaches use adversarial visual content to…
14 -
TopoGraphRAG-Bench: Evaluating Multimodal GraphRAG on Layout-Grounded Evidence Reasoning
arXiv:2610.09360v1 Announce Type: cross Abstract: Real-world documents distribute evidence across text, tables, figures, and captions within complex page layouts. Answering complex questions over such documents therefore requires more than retrieving relevant passages: systems…
33 -
The Confidence Game: Strategic Miscalibration in Human-AI Delegation
arXiv:2610.09371v1 Announce Type: cross Abstract: Calibrated uncertainty quantification is essential to ensuring AI agents are trustworthy and reliable. However, when agents seek to maximize user engagement or revenue, confidence reports may be strategically distorted,…
22 -
Finding the Right Balance: Relevance and Diversity in LLM Retrieval
arXiv:2610.09412v1 Announce Type: cross Abstract: Retrieval diversification is widely available in retrieval-augmented generation (RAG) frameworks, yet prior studies disagree on whether it improves retrieval and answer quality. We show that its effectiveness varies primarily…
37 -
Boundary-Free Contextual Biasing: Depth-Adaptive Gating and Reading-Space Matching for Unsegmented Languages
arXiv:2610.09467v1 Announce Type: cross Abstract: Contextual biasing supplies an ASR system with a list of expected words at inference time, but existing methods rely on word boundaries that Japanese and Chinese do not provide. We present a boundary-free biasing decoder for…
38 -
CHASE: Channel-Aligned Structure Exploitation for Geometry-Aware Model Engineering
arXiv:2610.09476v1 Announce Type: cross Abstract: Geometric and Spectral Alignment (GSA) characterizes trained networks through spectral concentration, physical-channel alignment, support structure, and changes in singular bases. In this paper, we propose CHASE (Channel-Aligned…
19 -
Mitigating Accent-Language Confusion in Self-Supervised Speech Representations for Language Identification
arXiv:2610.09486v1 Announce Type: cross Abstract: Spoken language identification (LID) aims to recognize the target language regardless of accent. In practice, however, LID models fine-tuned from self-supervised speech representations frequently confuse accents with languages,…
36 -
Certified by Abstention: Distribution-Free Guarantees for Chain-of-Thought Verifiers at Small Calibration Budgets
arXiv:2610.09541v1 Announce Type: cross Abstract: Signals that predict whether a chain-of-thought (CoT) trace is correct are compared by AUC, but deploying one requires a threshold with a guarantee. We ask what distribution-free selective guarantees deliver for CoT verifiers at…
23 -
Constitution-Guided Watermarking
arXiv:2610.09552v1 Announce Type: cross Abstract: Watermarking enables language model providers to identify text generated by their models. However, its desired properties can conflict (\ie~stronger watermark signals can degrade text quality), while designs that resist editing…
8 -
Collaborative Reasoning Distillation via Cross-Feedback and Coherent Curation
arXiv:2610.09587v1 Announce Type: cross Abstract: Reasoning capabilities are critical for advancing Large Language Models, yet current approaches either require massive computational budgets or struggle to effectively distill reasoning to smaller models. Standard distillation…
38 -
Coding-Agent Benchmarks Should Match Their Users' Task Flows
arXiv:2610.09633v1 Announce Type: cross Abstract: The evaluation of coding agents generally strives to be as realistic as possible. In our study, we collect 4,782 agent sessions of real software engineers in JetBrains IDEs, which we call Production Sessions. Since our subject is…
6 -
When Rank Rises as LLMs Degrade
arXiv:2610.09647v1 Announce Type: cross Abstract: Post-training adapts language models in non-stationary environments. Practitioners monitor representation health with RankMe and related spectral statistics, often assuming that rank falls when representations degrade. We show…
8 -
Towards Explaining Query Expansion Performance in Information Retrieval
arXiv:2610.09724v1 Announce Type: cross Abstract: Query Expansion (QE) techniques have long been widely used in Information Retrieval (IR) to address the vocabulary mismatch problem. They remain relevant in modern retrieval systems, including those based on large language models…
10 -
PARC-Loc: Text-to-Point-Cloud Localization with Partial Assignment and Relational Consistency
arXiv:2610.09761v1 Announce Type: cross Abstract: Text-to-point-cloud localization estimates a position in a city-scale 3D map from descriptions of surrounding objects. Existing coarse-to-fine methods retrieve submaps using aggregate learned compatibility and then localize…
16 -
From Expert-Guided Proof Search to Automated Open-Problem Solving
arXiv:2610.09769v1 Announce Type: cross Abstract: Large language models are increasingly contributing to mathematical research, where progress often depends on efficient proof search, incremental improvements and careful verification. We describe Bolzano, a multi-agent…
4