arXiv — NLP / Computation & Language
500 articles archived · Visit source ↗ · RSS
-
arXiv — NLP / Computation & Language research 9d ago
HakemBench: A Turkish Benchmark of Typed Decisions
arXiv:2610.02293v1 Announce Type: new Abstract: HakemBench is a Turkish benchmark of typed decisions, in which the model under test reads a text, a question and a fixed set of options and returns a probability for every option. Version 1.0 is released fully open under CC BY 4.0,…
38 -
Finding the Move Is Not Winning the Game: XiangqiBench for Closed-Loop Evaluation of LLM Agents
arXiv:2610.02425v1 Announce Type: new Abstract: Static evaluations credit a language model for naming the right move, but an agent must carry a plan through to a verified outcome while an opponent responds. We introduce XiangqiBench, an executable benchmark that measures this…
34 -
Counterexample Generation via Per-Theorem Symbolic Verifiers: When Imitation Hurts and Reinforcement Repairs
arXiv:2610.02444v1 Announce Type: new Abstract: Large language models often solve a theorem forward yet fail to disprove a closely related false one: a falsification gap that supervised fine-tuning does not close and can actively worsen. We frame counterexample generation as…
23 -
FinDialogLens: Event Extraction over Multi-Party Dialogue for Missed-Trade Identification in Financial Chatrooms
arXiv:2610.02455v1 Announce Type: new Abstract: Multi-party financial chatrooms are vital for sales-and-trading professionals, but their complexity makes manual recovery of missed trades infeasible: each Request for Quote (RFQ) is an event whose final price and trade outcome…
12 -
CUEing User Simulators: Calibrated User Embeddings for Multi-Turn Benchmarking
arXiv:2610.02460v1 Announce Type: new Abstract: Recent benchmarks rely on user simulators to evaluate AI agents in multi-turn interaction. While existing simulation techniques demonstrate surface fidelity to human style and behavior, ecologically valid interactive benchmarking…
12 -
APDMem: Agent-Controlled Progressive Disclosure for Query-Adaptive Long-Term Memory
arXiv:2610.02472v1 Announce Type: new Abstract: Personalized LLM assistants must recover sparse evidence from long conversation histories across queries of varying complexity. We introduce APDMem (Agent-controlled Progressive Disclosure Memory), a hierarchical long-term memory…
7 -
From Retrieval to Typed Decisions: Calibrated System One Models from Biomedical Sentence Encoders
arXiv:2610.02486v1 Announce Type: new Abstract: Typed decision models answer schema-constrained questions about a text in one forward pass and return probabilities meant to be thresholded. We ask whether biomedical sentence encoders trained for retrieval are good starting points…
19 -
A generative-informed neuro-symbolic framework for syntactic ambiguity resolution: Evidence from Arabic DPs
arXiv:2610.02529v1 Announce Type: new Abstract: Syntactic ambiguity poses a persistent challenge for Arabic NLP, particularly in morphologically rich nominal constructions where multiple structu6ral interpretations may be compatible with the same surface sequence. This study…
5 -
Evaluating Multi-Dimensional Generalization of Large Language Models in Temporal Extraction Tasks
arXiv:2610.02549v1 Announce Type: new Abstract: Time and event expression extraction are fundamental temporal reasoning tasks, but the problem remains difficult due to annotation ambiguity, domain sensitivity, and unstable model behavior. Existing evaluations focus on in-domain…
29 -
Learning When to Commit from Partial Speech for End-to-End Simultaneous Speech Translation
arXiv:2610.02612v1 Announce Type: new Abstract: Simultaneous speech translation must emit useful target text before the source is complete while preserving every committed token. We adapt a full-utterance speech language model using prefix supervision derived from its own…
15 -
Large Language Continuous Diffusion Models
arXiv:2610.02665v1 Announce Type: new Abstract: Despite the success of discrete diffusion language models (dLMs) for fast parallel decoding, their non-smooth, high-dimensional space hinders trajectory steering for reasoning and inference acceleration. To overcome this, we…
29 -
Silent Dissent: LLM Agents That Yield to the Majority Still Represent Their Original Premise
arXiv:2610.02702v1 Announce Type: new Abstract: Multi-agent debate is increasingly used to reach consensus among LLM agents, yet agents often yield to a unanimous majority. When an agent changes its answer, has it changed its mind or only its statement? We study this with…
35 -
WakeKV: Reactive, Reversible KV Residency for Heads That Change Their Minds
arXiv:2610.02713v1 Announce Type: new Abstract: Most KV-cache compression methods classify attention heads once, either offline or during prefill, and keep this classification fixed throughout generation. Across three models (1.5B-8B) and three regimes (needle retrieval, long…
24 -
TPBench: A Turning-Point Benchmark for Dialogue Compression
arXiv:2610.02736v1 Announce Type: new Abstract: A compressor can keep the facts of a dialogue and still drop the turn that changed them. A user corrects a price, reverses a choice, or adds a constraint. We call this failure turning-point eviction. One overall retention score…
35 -
Beyond Correctness: Resolving Underspecification in Agentic Text-to-SQL
arXiv:2610.02739v1 Announce Type: new Abstract: Agentic Text-to-SQL systems can interact with users to clarify underspecified queries before generating SQL. However, a correct execution result does not necessarily imply that the agent has adequately resolved the underlying…
30 -
EpiWorld: Grounding LLM Policy Agents in Epidemiological World Models
arXiv:2610.02744v1 Announce Type: new Abstract: Epidemic intervention policies are textual artefacts that human decision-makers interpret, justify, and revise through natural language, making large language models a natural candidate for epidemic policy reasoning. A naive LLM,…
13 -
When History Fails to Become Experience: Action Calibration in Language Agents
arXiv:2610.02769v1 Announce Type: new Abstract: Language agents should draw on prior attempts and environmental feedback to improve subsequent decisions within the same task. However, providing additional interaction history can sometimes reduce task success, suggesting that…
5 -
AptMQL-Bench: From Text-to-SQL to Text-to-MQL via Access-Pattern Schema Design and Data-Preserving Migration
arXiv:2610.02770v1 Announce Type: new Abstract: Document databases such as MongoDB are core infrastructure for modern applications, and natural-language interfaces to them---text-to-MQL---would let non-experts query complex, semi-structured data without mastering the query…
16 -
Improving Atomic-Fact Recall via Focused Views in Unstructured Knowledge Editing
arXiv:2610.02772v1 Announce Type: new Abstract: Large language models (LLMs) increasingly serve as general-purpose interfaces to factual knowledge, but their parameters do not automatically reflect information that changes after pretraining. Knowledge editing (KE) provides a…
6 -
Automatic Evaluation of Mental Health Stigma in Online Communication
arXiv:2610.02775v1 Announce Type: new Abstract: Mental health stigma has profoundly harmful impacts but its complexity makes it difficult to evaluate. Stigma may involve explicit derogation, but also subtler forms of blame, fear, paternalistic pity, social distancing, structural…
24 -
Text-Centric Post-Training for Omni-Modal Reasoning
arXiv:2610.02819v1 Announce Type: new Abstract: Improving joint audio-visual reasoning in Omni Large Language Models typically incurs substantial data construction and training costs. Our diagnostics reveal multi-hop reasoning difficulties despite correct answers to all…
26 -
Clinical Concept Centers in LLMs
arXiv:2610.02829v1 Announce Type: new Abstract: Large language models are increasingly used in clinical settings. However, research into the reliability and performance of these models has focused almost entirely on the language substrate, scoring what the model says.…
7 -
How Robust Is Multimodal Claim Verification to LLM Rewriting?
arXiv:2610.02841v1 Announce Type: new Abstract: LLMs are known to introduce stylistic changes into generated text, yet how these stylistic shifts affect model decisions on scientific tasks remains underexplored. In this paper, we focus on multimodal claim verification, where the…
26 -
Adaptive Mutual Distillation for Balanced Multi-Task Post-Training of Large Language Models
arXiv:2610.02856v1 Announce Type: new Abstract: Multi-task post-training of large language models (LLMs) aims to improve performance across tasks with unequal amounts of training data. Existing methods focus primarily on balancing task contributions during single-model training.…
36 -
ConvoDrift: A Multi-Turn Conversational Dataset for Modeling Stylistic Tone Evolution
arXiv:2610.02873v1 Announce Type: new Abstract: The evolution of linguistic style in conversations is an underexplored issue in NLP. Most style-control datasets focus on sentences or assume a static style throughout, missing the dynamic shifts that occur as user preferences…
22 -
Query-aware routing for Cross-lingual performance gains in Encoders
arXiv:2610.02875v1 Announce Type: new Abstract: Multilingual encoders can exhibit reduced retrieval effectiveness when queries and relevant documents differ in language, despite strong same-language performance. We investigate whether Finnish and Swedish cross-lingual retrieval…
4 -
Evaluating LLM-as-a-Judge Beyond Score Alignment: A Psychometric Analysis of Residual Judging Difficulty
arXiv:2610.02877v1 Announce Type: new Abstract: Large language models (LLMs) are widely used as automatic judges, with validity typically assessed via alignment with human scores. However, aggregate agreement fails to reveal whether humans and LLMs find the same evaluation cases…
11 -
Evaluating VQA in Vision Language Models using Cooperative Principles
arXiv:2610.02878v1 Announce Type: new Abstract: We evaluate the performance of Vision Language Models in Visual Question Answering (VQA) when questions violate Grice's maxims. To do this, we use VLMs to generate question modifiers that add non-essential, ambiguous or false…
26 -
Misinformation Without Triggers: From Factual Answers to Downstream Decisions
arXiv:2610.02886v1 Announce Type: new Abstract: Language models learn from web documents, some of them false, and false content can reach a model's answer to a factual question and the summaries and decisions that use it. Most data-poisoning studies add a trigger to the training…
20 -
Output Language Confusion under Multilingual Prompt Contamination
arXiv:2610.02926v1 Announce Type: new Abstract: Standard factual benchmarks assume clean monolingual prompts and exact-match scoring, two assumptions that break simultaneously in real-world multilingual deployment, from retrieval-augmented generation pipelines returning…
36 -
Enhancing Biomedical Named Entity Recognition via Multiple Programming Languages Instruction Tuning and Ensemble Method
arXiv:2610.02949v1 Announce Type: new Abstract: Instruction tuning has become a common paradigm for applying large language models (LLMs) to biomedical named entity recognition (BioNER). However, existing instruction-tuning approaches still face two key challenges. First,…
15 -
A Guideline-Augmented Multi-Agent Framework for Schema-as-Code Biomedical Named Entity Recognition
arXiv:2610.02970v1 Announce Type: new Abstract: Large language models (LLMs) have shown promising potential for biomedical named entity recognition (BioNER) through instruction following and in-context learning. However, existing LLM-based BioNER methods still face two key…
17 -
OLMo-Detect: A Multi-Stage, Confounder-Controlled Benchmark for Membership Inference on Large Language Models
arXiv:2610.02986v1 Announce Type: new Abstract: Membership inference on large language models (LLMs) aims to determine whether a given text sample was included in an LLM's training data, without access to its training corpus. Despite recent progress, existing benchmarks suffer…
38 -
OmniConfess: Eliciting Token Confessions to Mitigate Omni-Modal Hallucination
arXiv:2610.02999v1 Announce Type: new Abstract: Omni-modal large language models (OmniLLMs) unify text, images, audio, and video, yet hallucinate when generation relies on the wrong evidence. Existing inference-time methods can reduce hallucinations, but rarely reveal which…
29 -
Recursive Self-Improvement in Unified Multimodal Models
arXiv:2610.03002v1 Announce Type: new Abstract: Unified multimodal models (UMMs) understand and generate both text and images, which lets a model produce its own training data. Existing self-improvement in UMMs keeps supervision on the visual side, where image understanding…
35 -
HyperThink: Text-to-Parameter Hypernetworks for Efficient Reasoning
arXiv:2610.03039v1 Announce Type: new Abstract: Long-form thinking traces can substantially improve the multi-step reasoning performance of large language models (LLMs), but they introduce high inference-time overhead, with latency dominated by sequential decoding. We propose…
25 -
The Geometry of Knowledge Accessibility in Large Language Models
arXiv:2610.03052v1 Announce Type: new Abstract: Large language models (LLMs) contain broad knowledge, but they cannot access all of it reliably. We study this problem through knowledge accessibility, which describes whether the knowledge needed for a query can be recalled from…
9 -
HARPO: Hallucination-Aware Reinforcement Learning for Faithful and Creative Language Generation
arXiv:2610.03063v1 Announce Type: new Abstract: Large Language Models (LLMs) are prone to generating hallucinated content, which compromises their reliability in knowledge-intensive tasks. To address this challenge without sacrificing creativity, we propose HARPO, a…
7 -
Unmasking Propaganda: A Comparative Analysis of Masked and Causal Language Models
arXiv:2610.03077v1 Announce Type: new Abstract: Propaganda detection is an essential task in natural language processing (NLP), particularly in the context of manipulative political communications. However, identifying specific propaganda techniques presents a significant…
24 -
An automated pipeline for standardised speech-unit annotation in spontaneous dialogue
arXiv:2610.03078v1 Announce Type: new Abstract: Quantifying conversational dynamics requires reliable identification of interactional units and their temporal boundaries, but speech activity alone does not distinguish conversational turns from listener feedback or within-turn…
36 -
Ask, Relax, or Act? Evaluating Actionable Indeterminacy in LLM Preference Reasoning
arXiv:2610.03102v1 Announce Type: new Abstract: An LLM agent can recognize uncertainty yet still choose the wrong next step: asking when action is already justified, or seeking clarification when the constraints must change. We formalize actionable indeterminacy: act when an…
16 -
Emergent Structure in the Marginal Attention Space of Language Models
arXiv:2610.03109v1 Announce Type: new Abstract: While representation similarity across independently trained language models is well-documented, how internal mechanics such as attention behave across models remains far less characterized. Inspired by this gap, we examine the…
13 -
Ontological Instability and Statistical Amplification: The Paradox of "Humanizing" LLM-Generated Text
arXiv:2610.03110v1 Announce Type: new Abstract: Supervised AI-text detectors report high benchmark accuracy, but it is not clear what their decisions are based on. We analyze a RoBERTa-based detector under semantic, structural, and tokenizer-level perturbations, using the M4…
4 -
Building Interpretable Feature Representations for Resume-Vacancy Matching by Distilling Production LLM Signals
arXiv:2610.03112v1 Announce Type: new Abstract: Matching candidates to vacancies is central to recruitment, and a recruiter needs to see why a candidate fits, not only a single opaque relevance score. We provide this evidence as named, interpretable matching dimensions…
12 -
Investigating the Role of Reasoning-Language Alignment in Monolingual Retrieval-Augmented Generation
arXiv:2610.03136v1 Announce Type: new Abstract: Reasoning traces improve large language models (LLMs), but current models are trained to reason mostly in English. It has been shown that forcing a model to reason in another language degrades accuracy, even when the reasoning…
28 -
Predicting Steering Vectors and Adapter Weights for Few-Shot Author-Style Transfer
arXiv:2610.03163v1 Announce Type: new Abstract: Adapting large language models to an individual author's style from a few examples is challenging, and scientific writing sharpens the difficulty: formal conventions leave little surface variation, and authors write about their own…
8 -
Hindsight-Guided Rationale Distillation for Rare Disease Diagnosis
arXiv:2610.03176v1 Announce Type: new Abstract: We study hindsight-guided distillation for rare disease diagnosis on ZebraMap: a 1.5B student is fine-tuned on chain-of-thought traces from a 8B teacher that observes the ground-truth diagnosis during generation. Absolute accuracy…
26 -
Not Until the Evidence Says So: Teaching LLM Investigators When to Close a Case
arXiv:2610.03190v1 Announce Type: new Abstract: Accident, defect and outage investigations end with a decision that ordinary question answering never faces: whether the evidence gathered so far is enough to close the case. We study this decision for LLM investigators, which…
31 -
Source Preference in the Wild: How LLM Agents Favor Items by Source, and How to Reduce It
arXiv:2610.03195v1 Announce Type: new Abstract: As LLM agents decide on users' behalf which product to buy, which hotel to book, or which paper to cite, a preference for items from certain sources (the sites or services they come from) shapes what users receive and which sources…
10 -
StanceEval 2026: The Second Stance Detection Shared Task
arXiv:2610.03215v1 Announce Type: new Abstract: StanceEval 2026 is the second edition of the StanceEval shared task series on stance detection in Arabic social media text. Stance detection aims to identify a writer's stance toward a given topic. Given a tweet and a target,…
16