arXiv — NLP / Computation & Language
500 articles archived · Visit source ↗ · RSS
-
arXiv — NLP / Computation & Language research 10d ago
Collective Bias Mitigation via Model Routing and Collaboration
arXiv:2610.03240v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in public health, finance, and governance, requiring both accuracy and societal value alignment. Despite recent advances, LLMs often perpetuate or amplify bias embedded in…
33 -
Shrome at Touch\'e: Soft-Vote Ensembling and Counter-Causal Augmentation for Causality Extraction
arXiv:2610.03268v1 Announce Type: new Abstract: Touch\'e 2026 extends causality extraction to counter-causal claims: news sentences whose surface form appears causal but whose meaning denies the causation, as in "It is falsely believed that X caused Y." A system that relies on…
32 -
To Jev or Not? Evaluating the Accuracy and Efficiency of Structured Decision Models for Hate-Speech Moderation
arXiv:2610.03324v1 Announce Type: new Abstract: The scale of online content makes hate-speech moderation challenging, while Large Language Models (LLMs) enable harmful material to be produced and adapted more easily. Moderation therefore requires efficient classifiers that can…
37 -
SyntaxBench: A Statistical Diagnostic Framework for Character-Level Reasoning in Large Language Models
arXiv:2610.03329v1 Announce Type: new Abstract: Large language models are increasingly used where small syntactic errors matter, yet character-level reasoning is still evaluated mostly through isolated probes and aggregate accuracy. We introduce SyntaxBench, a diagnostic…
8 -
CLIMB: Confidence-Guided Complementary Evidence for Multimodal Retrieval-Augmented Generation
arXiv:2610.03421v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have shown strong visual reasoning abilities, but knowledge-intensive visual question answering often requires external textual evidence beyond the image and the model's parametric…
17 -
Single-Pass Uncertainty Heads for Claim-Level Hallucination Detection in Persian Medical Language Models
arXiv:2610.03482v1 Announce Type: new Abstract: Hallucination detection is particularly important for medical language models, but repeated-sampling approaches are expensive and existing uncertainty-head resources do not directly transfer to a new backbone and language. We adapt…
31 -
Learning from Repaired Reasoning: Root-Cause-Guided On-Policy Distillation
arXiv:2610.03515v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) uses reference solutions as privileged hindsight to supervise student-generated reasoning trajectories. However, reference-based guidance may explain a correct solution without addressing why the…
29 -
Structured Composition of Verifiable Atomic Insights for Table-to-Report Generation
arXiv:2610.03525v1 Announce Type: new Abstract: Table-to-report generation refers to the task of automatically generating article-level analyt- ical reports from relational tables and is an essential capability for automated data science and decision support. Its central…
30 -
Author Representation Strategies for Zero-Shot Authorship Attribution: A Comparative Study of LLM-Based and Embedding-Based Approaches
arXiv:2610.03531v1 Announce Type: new Abstract: Authorship Attribution (AA) requires capturing fine-grained stylistic characteristics, making it particularly challenging in zero-shot (ZS) settings where no task-specific supervision is available. In this work, we investigate the…
27 -
Writerslogic at PAN 2026: Process over Content for Robust Detection under Domain Shift
arXiv:2610.03565v1 Announce Type: new Abstract: We describe the Writerslogic systems for three PAN at CLEF 2026 shared tasks (Reasoning Trajectory Detection, Voight-Kampff Generative AI Detection, and Multi-Author Writing Style Analysis), unified by a shared analytical…
15 -
Writerslogic at the CLEF 2026 SimpleText Track: Multi-Candidate LLM Simplification and Stacked Complexity Spotting
arXiv:2610.03567v1 Announce Type: new Abstract: We describe the Writerslogic team's participation in the CLEF 2026 SimpleText shared task, addressing Task 1 (text simplification) and Task 2 (complexity spotting). For Task 1, we develop a multi-candidate generation pipeline using…
37 -
FALCON: A Model and Dataset Agnostic Framework for Synthetic Data Generation for NL2SQL Pairs
arXiv:2610.03625v1 Announce Type: new Abstract: Relational databases are among the most widely deployed forms of structured knowledge, and natural language access to them requires grounding language onto schema entities and relations while handling the ambiguity inherent in how…
32 -
Language Models that Play Chess and Explain Their Moves
arXiv:2610.03695v1 Announce Type: new Abstract: Modern chess engines are silent experts: they play at a superhuman level, but do not offer explanations for their play. On the other hand, language models (LMs) can generate plausible-sounding explanations, but their weak playing…
33 -
Budgeted Cache Repair for Cross-Context KV-Cache Reuse
arXiv:2610.02233v1 Announce Type: cross Abstract: Cross-context KV-cache reuse predicts a shared segment's keys and values under a new prefix instead of recomputing them, and has been reported to do so without quality loss. We find otherwise, and identify two problems. (1) A…
16 -
Fast Models, Slow Evidence: A Paired and Self-Audited Evaluation of System-1 Decision Models for LLM Agent Harnesses
arXiv:2610.02267v1 Announce Type: cross Abstract: Agent harnesses make many small, typed decisions per task: which model to call, which tool to use, whether retrieved text is relevant, whether an input carries an injection. System-1 decision models answer such questions in a…
7 -
Does Every User Need a Private LoRA? Decoupling Personalization from Per-User Adaptation
arXiv:2610.02353v1 Announce Type: cross Abstract: Personalized large language models often require a complete adaptation state for each user. However, this paradigm scales poorly as the user population grows. We revisit this design through the lens of personalization capacity…
11 -
Lexicographic Multi-Objective On-Policy Distillation
arXiv:2610.02359v1 Announce Type: cross Abstract: Reinforcement learning from verifiable rewards (RLVR) usually optimizes answer correctness, yet useful language-model behavior also requires high-quality reasoning and concise responses. Existing multi-reward post-training…
25 -
SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agents
arXiv:2610.02361v1 Announce Type: cross Abstract: Large language model (LLM)-driven evolutionary search is a powerful paradigm for automated program and algorithm discovery, yet existing systems are largely memoryless: each run explores from scratch, so agents repeatedly…
19 -
Social bot detection in the age of ChatGPT: Challenges and opportunities
arXiv:2610.02386v1 Announce Type: cross Abstract: We present a comprehensive overview of the challenges and opportunities in social bot detection in the context of the rise of sophisticated AI-based chatbots. By examining the state of the art in social bot detection techniques…
23 -
Hesitation Has a Geometry: Entropy-Trained Hyperbolic Probes for Sparse Activation Steering
arXiv:2610.02391v1 Announce Type: cross Abstract: When a large language model solves a mathematical problem, its reasoning is largely hierarchical, and the solution often branches at a few tokens where the next-token entropy is high. Such tree-like structure embeds in hyperbolic…
7 -
Trained Agentic Context Management
arXiv:2610.02404v1 Announce Type: cross Abstract: We study long context language models. Instead of training long context natively, or designing a long context harness, we train a model over the simplest possible harness: a tool to call itself with any specified prompt and a…
7 -
Evaluating and Improving the Robustness of Large Language Models to Input Sequence Variations
arXiv:2610.02432v1 Announce Type: cross Abstract: Large language models (LLMs) in production systems face prompt injections, trojans (backdoors), and manipulation of automatic quality metrics. This thesis develops models, methods, and algorithms for evaluating and improving LLM…
13 -
Are you Synthesizing or Recalling? Evaluating LLMs on Algorithmic Code Retrieval
arXiv:2610.02438v1 Announce Type: cross Abstract: Large language models (LLMs) have demonstrated strong performance in code generation, where success depends on both recalling relevant algorithmic knowledge and reasoning about how to apply it. However, existing LLM pipelines are…
17 -
Capability Scaling-Down Laws for LLM Compression
arXiv:2610.02462v1 Announce Type: cross Abstract: LLM compression reduces inference costs and memory requirements, but selecting a method and configuration remains largely empirical because comparable resource reductions can produce different capability losses. We systematically…
33 -
Right Order, Wrong Scale: Auditing LLM Judges for Occupational AI Measurement
arXiv:2610.02492v1 Announce Type: cross Abstract: LLM judges are increasingly used to assess whether AI outputs meet workplace requirements, but agreement on response rankings does not establish agreement on acceptance rates or occupational aggregates. We introduce O*NET-BENCH,…
22 -
How Causality Bridges the Semantic Gap
arXiv:2610.02594v1 Announce Type: cross Abstract: Numerical measurements capture how a system behaves, but often leave the meanings of its variables unspecified. Some variables are measured but never labeled, and others are never measured at all. Existing methods assign…
16 -
VERSE: Verified Self-Evolving Optimizer for Agent Harnesses
arXiv:2610.02616v1 Announce Type: cross Abstract: Harness evolution improves an LLM agent's prompts, tools, and workflow, while the optimizer's own tools and procedures often remain fixed. We study whether an optimizer can improve another agent more effectively by also improving…
35 -
LEAP: Learning Efficient Action Proposals For LLM Agents
arXiv:2610.02670v1 Announce Type: cross Abstract: LLM agents are known to be slow in rollouts. An agent completes a task one step at a time. At each step, it reasons and then chooses an action to execute. The next step and action cannot start until the previous one has finished.…
9 -
Asterism: Exploring and Synthesizing Scattered Observations into Literature-Grounded Hypotheses and Theories
arXiv:2610.02673v1 Announce Type: cross Abstract: A theory draws many independent observations into one framework with novel hypotheses. A researcher building such a theory must synthesize observations scattered across many papers, each describing related concepts but often in…
14 -
Large language models exhibit unreliable updating of clinical judgment as patient evidence evolves
arXiv:2610.02684v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly explored for clinical reasoning, but whether they appropriately revise judgments as patient evidence evolves remains unclear. We evaluated longitudinal belief updating using matched…
31 -
Learning from Evolving Errors: Adaptive Iterative Repair for On-Policy Distillation
arXiv:2610.02700v1 Announce Type: cross Abstract: On-policy self-distillation (OPSD) supplies dense token-level feedback on trajectories sampled from the student's own policy, a richer training signal than the outcome-level rewards of reinforcement learning. This feedback comes…
17 -
OPD Before RL: Warm-Starting Rubric-Based RL with On-Policy Distillation
arXiv:2610.02781v1 Announce Type: cross Abstract: Many useful language-model tasks cannot be evaluated by exact outcome verification. Rubric-based reinforcement learning (RL) addresses this issue by scoring open-ended responses against explicit criteria. However, because the…
14 -
ROUTEAUDIT: Interaction-Aware Identification for Budgeted Multi-Verifier Routing
arXiv:2610.02808v1 Announce Type: cross Abstract: Adaptive multi-verifier systems are commonly compared through endpoint quality-cost gaps, even when the verifier catalog, availability, accounting, information filtration, or scorer changes with the policy. We formulate verifier…
7 -
RMCW: A Deletion-Robust Watermark Based on Reed--Muller Codes for Language Models
arXiv:2610.02817v1 Announce Type: cross Abstract: Large Language Model (LLM) watermarking provides a lightweight mechanism for identifying text generated by a specific model, but its robustness remains fragile under post-processing attacks. Deletion attacks are particularly…
13 -
FSPO: Policy-Consistent Risk and Pareto-Feasible Control for Budgeted LLM RL Post-Training
arXiv:2610.02828v1 Announce Type: cross Abstract: Adaptive LLM reinforcement-learning post-training changes multiple training actuators online, including rollout temperature, group size, clipping, KL regularization, verifier allocation, and update budget. Three coupled issues…
13 -
To Explore The Strange New World Beyond Data Distribution: System Behavior, Causality Tax, and Non-causal Base Model
arXiv:2610.02839v1 Announce Type: cross Abstract: We show that the causality of language models (LMs) may not be necessary nor optimal. This is the case when system behavior (denoted as $S$) is incorporated as a first-principle Bayesian feature. Here, $S$ refers to extra…
12 -
Probe the Harness: Setup Checks for Stale-Data RL Comparisons in Language Models
arXiv:2610.02911v1 Announce Type: cross Abstract: Methods for training language models on stale samples are judged by comparisons against importance-corrected baselines. We show that details of the experimental harness can reverse the observed ranking of methods, and we…
24 -
Continual Graph Memory for Mathematical Research Agents
arXiv:2610.02945v1 Announce Type: cross Abstract: Using frontier agent harnesses to tackle mathematical research problems has emerged as an effective means of advancing mathematics. However, solving frontier problems in mathematics may require a massive number of agents working…
11 -
Understanding Trajectory Heterogeneity in Federated World Model Learning
arXiv:2610.02957v1 Announce Type: cross Abstract: World models learn state evolution from trajectories, making access to temporal context a central training requirement. Federated learning can use distributed records, while ownership boundaries within a trajectory restrict the…
38 -
Sentry: Learning to Recover from LLM Agent Failures at Test Time
arXiv:2610.02994v1 Announce Type: cross Abstract: LLM agents often fail mid-task due to invalid tool calls, repeated actions, or poorly grounded reasoning, and learning from these failures is a path to reliability. We find that how failure knowledge reaches the agent matters as…
7 -
Personalized Automatic Speech Recognition for a Dysarthric and Tracheostomic Speaker using Artificial Conversations
arXiv:2610.03017v1 Announce Type: cross Abstract: This work presents an automatic speech recognition (ASR) system personalized for a Czech speaker with a permanent tracheal stoma and severe dysarthria rendering their speech unintelligible to untrained listeners. We release a…
29 -
ReSCUE: Re-translation with Sentence Commitment for Unsegmented Long-Form Simultaneous Sign Language Translation
arXiv:2610.03022v1 Announce Type: cross Abstract: Simultaneous Sign Language Translation (SLT) is critical for real-time communication, yet existing methods remain largely confined to sentence-level, offline settings that assume pre-segmented inputs. These assumptions hinder…
17 -
Verifiable, Articulable, and Tacit Components of Preference
arXiv:2610.03025v1 Announce Type: cross Abstract: What makes a short story gripping; a news article newsworthy; or a math proof elegant? These constructs resist articulation or verification; their meaning is at least partially tacit. However, modern AI models are improved…
35 -
Tailoring the Quantization Space for 1-Bit KV Cache Compression
arXiv:2610.03027v1 Announce Type: cross Abstract: The key-value (KV) cache becomes a major memory bottleneck in long-context LLM inference, placing substantial pressure on memory capacity and bandwidth. To mitigate this bottleneck, vector quantization (VQ) has emerged as a…
20 -
Adaptive Second-Order Solvers for Fast Stochastic Diffusion Sampling
arXiv:2610.03034v1 Announce Type: cross Abstract: Diffusion models rely on numerical solvers requiring time-discretization, which has a large influence on the tradeoff between sampling cost and quality. However, the computational difficulty of the reverse process varies along…
7 -
SecJev: Bringing Security Expertise to System One Decision Models
arXiv:2610.03073v1 Announce Type: cross Abstract: Security workflows need models that turn complex observations and explicit policies into decisions. System One models introduced by Jev return typed predictions and probabilities; security specialization supplies the domain…
26 -
MintEval: Do LLMs Implement the Trading Strategy You Asked For? A Behavioural-Equivalence Benchmark for Natural-Language-to-Strategy Code
arXiv:2610.03080v1 Announce Type: cross Abstract: Large language models are moving from producing trading signals to writing the code that executes them. The failure mode of the second role is silent: generated code runs, a backtest plots, yet the risk logic that the trader…
21 -
Peer Influence across Heterogeneous AI Models
arXiv:2610.03095v1 Announce Type: cross Abstract: When two AI agents disagree, who persuades whom? As multi-agent systems increasingly combine language models of different families and sizes, the answer can determine which judgments survive interaction. Measuring persuasion as…
7 -
The Fragility of Trigger-Tag Mechanisms for Misuse Detection in Open-Weight LLMs
arXiv:2610.03124v1 Announce Type: cross Abstract: Open-weight language models can be downloaded, modified, and deployed beyond their developers' control, limiting the effectiveness of centrally enforced safeguards. Recent work has therefore proposed \emph{trigger-tag} mechanisms…
20 -
Large Language Models are Approximate Survival Estimators
arXiv:2609.38181v1 Announce Type: new Abstract: Survival analysis estimates time-to-event outcomes from patient covariates and is widely used for medical risk assessment. Patients seeking prognostic information after a diagnosis may turn to large language models (LLMs), now…
12