arXiv — NLP / Computation & Language
500 articles archived · Visit source ↗ · RSS
-
arXiv — NLP / Computation & Language research 5d ago
Adapting English Quality Classifiers for Multilingual LLM Pretraining Data Selection
arXiv:2610.11585v1 Announce Type: new Abstract: Recent advances in large language model (LLM) pretraining highlight the role of high-quality training data in improving performance. While model-based filtering has proven effective in selecting high-quality subsets from web-scale…
25 -
Measuring Cultural Alignment Beyond the Average: A Framework for Evaluating Maternal-Health LLM Interactions in Indian Contexts
arXiv:2610.11586v1 Announce Type: new Abstract: Existing evaluation methods for healthcare LLMs primarily assess factual correctness,safety, and fluency, while providing limited insight into whether generated interactions reflect culturally situated healthcare reasoning. This…
23 -
Probing for Long-Horizon Deductive Reasoning Capabilities in Language Models with Prolog
arXiv:2610.11592v1 Announce Type: new Abstract: Current frontier LLMs can theoretically process long contexts with 1M tokens or more. But to what extent can they go beyond simple retrieval and perform deeper reasoning over such long contexts? We empirically investigate…
27 -
Large Language Model Turnover Undermines Screening for Artificial Intelligence-Assisted Scientific Writing
arXiv:2610.11599v1 Announce Type: new Abstract: Journals and conferences have begun to screen submitted manuscripts for text written using large language models (LLMs). The reliability of this screening rests on benchmark evaluations against a fixed set of LLM versions, while…
21 -
UXBench Pro: Benchmarking Personalized User Experience in Multi-Turn Dialogue Interactions
arXiv:2610.11638v1 Announce Type: new Abstract: Evaluating user experience (UX) with automated computational methods has gained increasing attention, supported by empirical evidence from UXBench. However, binary preference prediction provides limited insight, while relying on a…
8 -
Phonologically Informed Tokenization for German Speech Recognition: A Cross-Domain Study
arXiv:2610.11646v1 Announce Type: new Abstract: German is a morphologically rich language whose syllable structure is exceptionally well-predicted by the Knuth--Liang hyphenation algorithm. We ask whether phonologically informed tokenization can serve as a competitive target for…
10 -
DIAL-OPD: Learning More from Fewer Tokens in On-Policy Distillation
arXiv:2610.11659v1 Announce Type: new Abstract: On-policy distillation (OPD) supervises student-generated trajectories with token-level teacher signals. Its sampled-token variant avoids the cost of full-vocabulary probabilities. Yet we find that training on fewer tokens can…
31 -
TRACE: Diagnosing Verifier Brittleness in Agentic Evaluation
arXiv:2610.11678v1 Announce Type: new Abstract: Verifier scores now serve as both benchmark metrics and training rewards for large language model (LLM) agents, and a change in score is routinely read as a change in capability. It may instead reflect a change in the evaluation.…
29 -
Structured Sentiment Analysis Using Sequence Labeling as Dependency Graph Parsing
arXiv:2610.11695v1 Announce Type: new Abstract: This study addresses the problem of structured sentiment analysis, whose goal is to obtain a fine-grained sentiment graph where the nodes represent spans of sentiment holders, targets, and expressions, while the arcs define the…
30 -
Thinking Inertia: LLMs Keep Thinking When Told Not To
arXiv:2610.11765v1 Announce Type: new Abstract: Large Language Models (LLMs) increasingly ship with explicit "thinking modes", yet their counterpart, "no-thinking", has received far less attention. We study LLMs' no-thinking behavior along two axes. a. How to measure…
34 -
Same Outcome, Different Evidence: Intent Recovery in LLM Safety Evaluation
arXiv:2610.11766v1 Announce Type: new Abstract: Safety evaluations of large language models commonly summarize harmful-output behavior with attack success rate (ASR). Yet the same non-harmful outcome can arise for very different reasons. A model may recover a harmful task and…
26 -
DPPM: Dual-Path Parametric Memory for Personalized Language Models
arXiv:2610.11776v1 Announce Type: new Abstract: Long-term personalization requires language models to use interaction history to track users' preferences across sessions. Parametric memory encodes this interaction history into model parameters or adapters, reducing the need to…
30 -
From Sparse Representations to Behavioral Insights for Multimodal Depression Assessment
arXiv:2610.11787v1 Announce Type: new Abstract: Multimodal depression assessment offers a promising approach to analyzing behavioral patterns associated with depression. However, existing methods often rely on dense and opaque multimodal representations, making it difficult to…
26 -
Easy to anticipate, hard to compute: boundary dependence finds the computed outputs that entropy patching misses
arXiv:2610.11790v1 Announce Type: new Abstract: Byte-level language models such as the Byte Latent Transformer (BLT) group bytes into patches and run their large global model once per patch. BLT starts a patch where a small model's next-byte entropy is high, so global compute…
9 -
Detecting Spin in Clinical Trials with Large Language Models
arXiv:2610.11845v1 Announce Type: new Abstract: Spin in clinical trials includes reporting practices that distort the presentation of results. This is particularly critical in medicine, where spin is present in more than 50% of randomized controlled trials that fail to reach…
32 -
Forms of LLM-Integrated Applications from LLM-Chats to Autonomous AI Agent System
arXiv:2610.11899v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly embedded as components in software systems, marketed under labels such as chatbot, copilot, retrieval-augmented generation, workflow, coding agent and AI agent. Whether these labels…
36 -
Can Decision Models Understand Stance? Evaluating Jev Against General-Purpose LLMs
arXiv:2610.11901v1 Announce Type: new Abstract: Stance detection requires identifying an author's attitude toward a given target, sometimes based on conversational context. Jev, a specialized decision model designed for structured decision-making, offers an alternative to…
4 -
Not Every Change Is Necessary: Recoverable Drift in Large Language Model Unlearning
arXiv:2610.11915v1 Announce Type: new Abstract: Machine unlearning in large language models aims to remove unwanted knowledge while preserving the model's remaining capabilities. Although existing methods use retention objectives or restrict where edits occur, achieving the…
10 -
Event-Centric Memory with Query-Aware Graph Augmentation for Long-Term Conversational Agents
arXiv:2610.11920v1 Announce Type: new Abstract: For persistent and personalized conversational agents, memory systems can enable them to remember, update, and reason over long histories by storing past interactions and retrieving relevant information. Existing memory systems…
30 -
When History Helps and Hurts: Selective History Use across Multimodal Turns
arXiv:2610.11948v1 Announce Type: new Abstract: Reliable multimodal interaction depends on selective use of conversational history: an earlier question may remain relevant while its previous answer is outdated, whereas a current request may depend on historical evidence despite…
16 -
MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement
arXiv:2610.11959v1 Announce Type: new Abstract: Reinforcement learning (RL) is the central training paradigm for advancing large foundation models towards self-improvement. This report introduces the MiMo-V2.6 series, an omni-modal family that pushes the frontier of model…
36 -
Specialized Decision Models vs. General-Purpose LLMs: Benchmarking Jev Across Knowledge, Reasoning, and Multilingual Tasks
arXiv:2610.11978v1 Announce Type: new Abstract: Jev is a "System One" model that returns a choice among given options instead of generating text. We study how such a specialized decision model compares with general-purpose large language models (LLMs). We evaluate Jev on 13…
20 -
Examining Social Attribution in LLM Reasoning: A Theory-Guided Probing Methodology
arXiv:2610.12022v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in sociotechnical systems where social attribution, the reasoning process attributing external events to the causes and reasons of agents' social behaviors, plays a critical…
35 -
Natural Language to First-Order Logic LLM-based Autoformalization
arXiv:2610.12030v1 Announce Type: new Abstract: Large Language Models (LLMs) have renewed interest in autoformalization. Yet, when First-Order Logic (FOL) is considered as the target formalism, the field still lacks a unified task formulation and a systematic survey. This paper…
31 -
ILM: An AI-Powered Storytelling Educational Tool
arXiv:2610.12064v1 Announce Type: new Abstract: Digital technologies have made Islamic narratives more accessible, but existing platforms provide limited support for structured learning and comprehension of these stories, particularly in Arabic and multilingual settings. We…
20 -
All Verdicts are Not Equal: Rethinking LLM Judge Reliability
arXiv:2610.12083v1 Announce Type: new Abstract: LLM-as-a-Judge is the standard paradigm for NLP evaluation, yet its systemic reliability remains poorly understood despite being widely treated as a deterministic ground truth. We present a comprehensive reliability audit,…
34 -
A persistent accuracy ceiling in automated verbal deception detection
arXiv:2610.12118v1 Announce Type: new Abstract: Automated methods have been proposed to overcome the limitations of human verbal deception detection, but evidence remains fragmented across disciplines. We systematically reviewed 25 years of research (289 reports, 6,136…
13 -
Rehearse Everything, Remember Nothing: Attic-KV Rehearses What Will Be Read
arXiv:2610.12133v1 Announce Type: new Abstract: Many key-value (KV) caches are compressed before anyone knows what will be asked of them: a document cached for retrieval, a prompt prefix shared across requests, the memory of a long conversation. The prevailing approach scores KV…
22 -
Language-Specific Effects of Tokenizer Choice in Multilingual Language Models
arXiv:2610.12144v1 Announce Type: new Abstract: Tokenizer choice affects multilingual language modeling, but vocabulary capacity is finite and vocabulary size is often constrained: improving representation for some languages often comes at the expense of others. We therefore ask…
27 -
SciTBERT: A family of chronologically consistent language models for scientific and technological language processing
arXiv:2610.12207v1 Announce Type: new Abstract: Pre-trained transformer models are increasingly being used to study scientific and technological progress. Encoders tuned to paper or patent text outperform general-purpose models on downstream classification, regression, and…
38 -
Language Models as AI Research World Models
arXiv:2610.12235v1 Announce Type: new Abstract: AI research agents automate the cycle of proposing, implementing, and evaluating experiments, opening a path toward recursive self-improvement. Yet their ability to propose experiments outpaces their capacity to execute them in…
28 -
TokenRouter: Efficient Serving System for Token-Level LLM Routing
arXiv:2610.12242v1 Announce Type: new Abstract: Large language model (LLM) routing distributes inference work across different models, advancing the cost-quality Pareto frontier of LLM serving. While coarse-grained routing at the session or query level has been widely adopted in…
5 -
EgoVoice: Proactive Spoken Assistance from Egocentric Multimodal Streams
arXiv:2610.12248v1 Announce Type: new Abstract: Wearable augmented reality (AR) assistants are moving toward continuous real-world interaction, where they perceive the user's activity through first-person video and audio and provide timely spoken guidance without being…
20 -
HarnessSQL: Harness-Native Training for SQL Agents in Realistic Database Environments
arXiv:2610.12274v1 Announce Type: new Abstract: Text-to-SQL models are commonly trained to map questions directly to static queries, whereas real-world database agents operate through stateful, multi-turn interaction with live databases -- inspecting schemas, executing probe…
24 -
VFold: Symmetry-Aware Cross-Layer Value Cache Compression
arXiv:2610.12338v1 Announce Type: new Abstract: While caching key-value (KV) states accelerates Large Language Model (LLM) decoding, this cache can dominate memory usage at long context lengths. One solution is to compress this memory by exploiting inter-layer cache…
5 -
Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolution
arXiv:2610.12367v1 Announce Type: new Abstract: Skills, reusable procedural guidance added at inference, can substantially improve LLM downstream performance (Li et al., 2026). Prior work retrieves skills from a bank by semantic relevance, then uses them as inference-time…
36 -
Latent Core Tokenizer: Compress, but Meaningfully
arXiv:2610.12376v1 Announce Type: new Abstract: Tokenizers are commonly optimized for compression, but a compact vocabulary does not necessarily distribute its capacity evenly across languages. We introduce the Latent Core Tokenizer (LCT), a language-agnostic approach that…
36 -
Predicting Alignment Generalization with Value Representations
arXiv:2610.12410v1 Announce Type: new Abstract: LLM developers post-train their models to exhibit prosocial values and behavioral traits, which are enumerated in an alignment target. However, while recent post-training developments have yielded models that score highly on…
31 -
An Explainable Header-Centric Framework for Large-Scale Semantic Table Interpretation and Data Quality Assessment
arXiv:2610.10541v1 Announce Type: cross Abstract: Knowledge Graph (KG) quality depends not only on downstream graph validation, but also on the quality of tabular metadata used before integration. In metadata-only Semantic Table Interpretation (STI), where cell values are…
25 -
WorldBench: Evaluating LLMs on Three.js Voxel World Generation
arXiv:2610.10622v1 Announce Type: cross Abstract: Large language models can now write complete, interactive 3D worlds as code, but grading those worlds automatically is unreliable. Existing judges take one view of the output: a vision-language model scores a few rendered…
35 -
Recurrent Self-Improvement: Dynamic Cross-Loop On-Policy Distillation for Looped Language Models
arXiv:2610.10623v1 Announce Type: cross Abstract: Looped Language Models (LoopLMs) offer a parameter efficient approach to scaling reasoning by reusing shared parameters across recurrent computation steps. Despite their promise, effective post-training of LoopLMs remains…
14 -
Conversational Task Disambiguation over Tabular Data: Leakage-Aware Formulation, Benchmark Suite, and Training
arXiv:2610.10740v1 Announce Type: cross Abstract: Conversational task disambiguation over tabular data uses dialogue to resolve missing information about a user's intended task before producing a solution over tables or databases. Existing evaluation and training lack a…
18 -
Plan-and-Patch: Diffusion Language Models for Agentic Planning
arXiv:2610.10786v1 Announce Type: cross Abstract: Planning is increasingly important for long-horizon agents, where successful execution requires coordinating subgoals, tool use, and intermediate outcomes over many steps. Yet assumptions made during planning may be invalidated…
37 -
NavGPT-3: Harnessing Context in a Hierarchical Navigation Runtime
arXiv:2610.10787v1 Announce Type: cross Abstract: Language models trained with long-horizon agentic reinforcement learning can generalize knowledge through reasoning, express precise actions, and pursue goals over many steps, raising the ceiling on what an embodied agent can…
13 -
Conversational Voice Aesthetic Model with Reinforcement Learning from Human Listeners
arXiv:2610.10868v1 Announce Type: cross Abstract: We introduce Conversational Voice Aesthetic Model, a speech large language model for describing the voice aesthetics of real or synthetic speech responses in natural conversational contexts. Given a context and a response speech,…
4 -
Language Models for Page-Level Layout Decisions in E-commerce Search
arXiv:2610.10920v1 Announce Type: cross Abstract: E-commerce search pages are critical touchpoints for millions of online shoppers. While traditional search engines return a ranked list of results, modern E-commerce search pages increasingly incorporate recommender system…
14 -
StoreBench: A Live-Commerce Environment for Evaluating and Training Autonomous Operator Agents
arXiv:2610.10942v1 Announce Type: cross Abstract: Reinforcement learning environments are now a primary lever for improving large language model (LLM) capabilities in post-training, yet most agentic benchmarks remain static: the world moves only when the agent acts, the reward…
19 -
Measuring and Mitigating Solution Mode Collapse in RLVR
arXiv:2610.11064v1 Announce Type: cross Abstract: A language model (LM) can usually answer the same question in more than one way, but reinforcement learning with verifiable rewards (RLVR) is indifferent to which correct answer a model produces. A solution will earn the same…
12 -
GameCommBench: A Unified Benchmark and Type-Aware Evaluation for AI-Generated Game Commentary
arXiv:2610.11129v1 Announce Type: cross Abstract: Game commentary is an open-ended generation task requiring multimodal perception, strategic reasoning, and contextual knowledge. Existing AI-Generated Game Commentary (AI-GGC) studies remain fragmented across games, modalities,…
29 -
ActiveMedAgent: Cost-Aware Trajectory Learning for Multimodal Medical Diagnosis
arXiv:2610.11140v1 Announce Type: cross Abstract: Clinical diagnosis is inherently sequential: clinicians escalate from cheap to costly tests only when additional evidence is expected to resolve diagnostic uncertainty. We present ActiveMedAgent, a framework that brings this…
15