arXiv — NLP / Computation & Language
500 articles archived · Visit source ↗ · RSS
-
arXiv — NLP / Computation & Language research 5d ago
Diffu-LoRA: A Novel Low-Rank Adaptation for Personalized Diffusion Models
arXiv:2610.10550v1 Announce Type: new Abstract: Personalizing text-to-image diffusion models from a few reference images requires preserving subject identity while following prompts that describe new contexts. Full-model fine-tuning is parameter-intensive, whereas low-rank…
22 -
Wieszcz-XIX: A 3.1-Billion-Word Corpus of Pre-1918 Polish and Temporally Bounded Language Models Trained From Scratch
arXiv:2610.10592v1 Announce Type: new Abstract: Historical Polish is well documented as a language but annotated in machine-readable form only to about a million words for the period this paper covers; the rest sits behind optical character recognition of variable quality. We…
6 -
Large Language Model-Assisted Preparation of Transportation Management Plans: A Case Study with WisDOT WisTMP System
arXiv:2610.10650v1 Announce Type: new Abstract: Work zones are critical yet hazardous components of transportation infrastructure, requiring carefully designed Transportation Management Plans (TMPs) to ensure safety and mobility. However, TMP preparation remains labor-intensive…
20 -
Cognitive Thermometers: Machine Learning and Logical Complexity
arXiv:2610.10724v1 Announce Type: new Abstract: How does the human mind represent semantic categories? Why do natural languages favor certain meanings over others? Prior explanations have relied on logical definability and complexity, but these are highly sensitive to the choice…
10 -
Lossy Compressive Text Autoencoders
arXiv:2610.10738v1 Announce Type: new Abstract: Our work explores learning a compressed latent representation of text, at the intersection of data compression and representation learning. We propose an autoencoder architecture that performs residual downscaling and upscaling of…
19 -
Clarify, Then Focus: Statement Normalization for Conversation Analytics at Scale
arXiv:2610.10758v1 Announce Type: new Abstract: Enterprise conversation analytics asks many questions of millions of interactions. Each question can require reconstructing what people mean and identifying which information matters, repeating costly interpretive work across the…
35 -
Grammar Concept Annotation at Scale: Deployed Fine-Tuned Small Language Models Outperform Prompted Frontier Models
arXiv:2610.10827v1 Announce Type: new Abstract: Corrective feedback is among the best-evidenced drivers of second-language acquisition, yet corrections delivered during lessons rarely accumulate into an actionable view of grammar mastery. Prompted frontier models can provide…
26 -
Real Long-Term Memory for AI: A 50-Million-Token Window That Is Faster and Cheaper Than Recompute
arXiv:2610.10845v1 Announce Type: new Abstract: A large language model can only use the text that fits in its context window, and it recomputes its internal key-value (KV) state for a prompt every time the prompt is sent. We test a memory layer, the public package galahad-kv,…
8 -
Disentangling Linguistic and Paralinguistic Information with Routed Sparse Autoencoders
arXiv:2610.10865v1 Announce Type: new Abstract: Self-supervised speech encoders contain linguistic and paralinguistic information in a shared, entangled representation space. We combine a TopK sparse autoencoder with route-specific supervision and cross-factor adversaries.…
28 -
Sparse Attention Is Matrix Approximation, Not Choosing from a Bag of Values
arXiv:2610.10871v1 Announce Type: new Abstract: Large Language Models (LLMs) achieve strong performance across many domains, but their efficiency is limited by the quadratic cost of attention with respect to prompt length. Sparse attention reduces this cost by retaining only a…
15 -
Stochastic Teacher Intervention for Agentic On-Policy Distillation
arXiv:2610.10878v1 Announce Type: new Abstract: On-policy distillation (OPD) efficiently transfers capabilities from a stronger teacher to a student language model through dense token-level supervision on student-generated rollouts and has shown promise on complex tasks such as…
23 -
Large Language Models for Machine Translation Quality Annotation: Humans and Models Are Both Challenged
arXiv:2610.10918v1 Announce Type: new Abstract: Large Language Models (LLMs) are considered to be a more efficient and cost-effective alternative to human judgment for Machine Translation (MT) evaluation. With MT evaluation spanning a large number of language pairs, domains and…
17 -
AI4Fire: Evaluating Large Language Models on Wildfire Tasks
arXiv:2610.10946v1 Announce Type: new Abstract: Large language models (LLMs) are entering wildfire management, where overstated evaluations can cost property and lives. How do they perform on wildfire tasks, with and without grounding? Bare means a model receives the task input…
30 -
When Citations Mislead? A Claim-Level Benchmark for Legal Hallucination Detection
arXiv:2610.10971v1 Announce Type: new Abstract: Large language models are increasingly used in legal research and drafting, but they can still produce claims that sound convincing without being supported by the cited source. We introduce PARCEL, a benchmark for checking whether…
23 -
Back in Style: A Sociolinguistic Approach to Authoring and Measuring Persona Fidelity in User Simulation
arXiv:2610.10988v1 Announce Type: new Abstract: As agentic systems gain commercial popularity, user simulators increasingly serve as measurement instrument for their evaluation. However, the fidelity of simulated users in comparison to real human users is generally low, and…
24 -
Prompts versus Rules: Auditing and Controlling Speech Naturalness Behaviors in Voice User Simulators
arXiv:2610.11015v1 Announce Type: new Abstract: As voice agents gain more popularity commercially, the user simulators used to evaluate the deployed agents are also being developed to include more realistic, variable, and diverse speech naturalness behaviors -- disfluency,…
32 -
FedAlphaEdit: Null-Space-Aligned Merging for Collaborative Knowledge Editing
arXiv:2610.11033v1 Announce Type: new Abstract: Multiple institutions may each hold their own private knowledge edits and wish to integrate them into a single large language model without sharing raw edit requests. Null-space-constrained editing methods such as AlphaEdit…
19 -
Clinician use of language models diverges from how the models are evaluated
arXiv:2610.11069v1 Announce Type: new Abstract: Large language model (LLM) assistants are being deployed to clinicians across health systems, and judgments about their readiness rest largely on benchmark scores, most of them derived from examination questions or curated cases. A…
23 -
Lapras: Latent Reasoning for Time Series Language Models
arXiv:2610.11111v1 Announce Type: new Abstract: Time Series Language Models (TSLMs) offer a promising path toward time series understanding by reasoning over temporal signals and producing natural language answers and explanations. A common approach is Chain-of-Thought (CoT),…
17 -
SFT-as-Context Mitigates Forgetting in Supervised Fine-Tuning
arXiv:2610.11132v1 Announce Type: new Abstract: Supervised fine-tuning (SFT) equips large language models (LLMs) with specialized capabilities, but often comes at the cost of forgetting the general capabilities of their parent models (i.e., the pretrained models before…
29 -
Can a System-One LLM Perform Knowledge Tracing When Few or No Learners Are Logged?
arXiv:2610.11135v1 Announce Type: new Abstract: Knowledge tracing (KT) models need many logged learners, so a new course or platform starts without a usable model. In LLM-based KT the LLM generates the answer, which we call System-Two; it is either fine-tuned on the target data…
32 -
The "10th Juror": Open-Set Standpoint Screening for Bureaucratic Bias Detection
arXiv:2610.11136v1 Announce Type: new Abstract: Presupposing the boundaries of bias is itself a form of bias. We study closed-loop bias governance for Dutch government documents, where a system must detect biased language, ground decisions in legal and contextual evidence,…
38 -
Local Prototype Reconstruction for Text-Compatible Speech-to-LLM Bridge Pretraining
arXiv:2610.11159v1 Announce Type: new Abstract: Speech-to-LLM systems often connect a frozen speech encoder to a frozen large language model (LLM) through a small trainable bridge. The bridge is usually treated as plumbing, but it in fact defines the geometry of the…
12 -
LadderEdit: Edit-Level Residual Compression for Memory-Efficient Lifelong Editing of LLMs
arXiv:2610.11160v1 Announce Type: new Abstract: Lifelong editing of LLMs requires storing thousands of edits after acquisition. A widely used family of approaches attaches one LoRA adapter per edit, which preserves behavior but grows linearly in storage. To address this…
38 -
RAG-Stress: Probing the Limits of Evidence Reliance in Retrieval-Augmented Generation
arXiv:2610.11183v1 Announce Type: new Abstract: Following retrieved evidence does not guarantee factual correctness: misleading evidence can induce a model to replace an answer it previously gave correctly. Standard accuracy measures obscure this behavior by combining answer…
6 -
Gated Memory: Admission-Controlled Memory Formation for Conversational AI
arXiv:2610.11270v1 Announce Type: new Abstract: Personalized conversational AI relies on long-term memory systems that extract facts from user utterances and store them in persistent vector stores. Despite progress in retrieval, deduplication, and lifecycle management, the…
11 -
Phonological Interference in Multilingual Speech Models
arXiv:2610.11275v1 Announce Type: new Abstract: Phoneme-level models transcribe or generate speech as a sequence of phonemes, the smallest sound units that distinguish words. These models enable fine-grained pronunciation control and understanding, yet often fail on input that…
23 -
REMORY: Learning Residual Memory for Context Compaction
arXiv:2610.11287v1 Announce Type: new Abstract: Long-horizon agents compact their history to continue within a finite context window, but a textual summary alone may not support every subsequent decision. We introduce REMORY, a neural memory network that supplements the summary…
32 -
When Do We Need On-Policy Distillation? Distilling on Offline Student Rollouts Is Often Better
arXiv:2610.11291v1 Announce Type: new Abstract: On-policy distillation (OPD) has become increasingly popular for transferring teacher capabilities to student models. In this work, we ask a critical research question: Is on-policy sampling always beneficial for distilling…
32 -
BeliefScope: Diagnosing Evidence-Driven Revision and Pressure-Induced Shifts in Large Language Models
arXiv:2610.11305v1 Announce Type: new Abstract: A language model may revise the same proposition after receiving genuinely relevant evidence or after receiving directional user pressure that adds no relevant fact. The observable response shift alone therefore does not reveal…
28 -
From Retrieval to Reconstruction: Constructing Evolvable Cognitive Memory for Long-Term Dialogue
arXiv:2610.11314v1 Announce Type: new Abstract: Large Language Models (LLMs) serving as long-term dialogue agents require memory systems that support reliable reasoning over extended interactions. However, existing Retrieval-Augmented Generation (RAG) frameworks typically treat…
29 -
MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface
arXiv:2610.11316v1 Announce Type: new Abstract: System One models output constrained decisions and probability distributions rather than free-form text generation. While prevailing paradigms rely on structured schema objects to encode state, intent, and candidate choices, we…
5 -
ReCal: Calibrating Structured Pruning for On-Policy Distillation Recovery
arXiv:2610.11332v1 Announce Type: new Abstract: Structured pruning reduces the deployment cost of reasoning language models, but the resulting capability degradation can hinder subsequent on-policy distillation (OPD) recovery. Because OPD relies on student-generated…
12 -
Deception by Omission: Language Models Knowingly Hide Their Mistakes
arXiv:2610.11351v1 Announce Type: new Abstract: Large language models (LLMs) increasingly act as agents with little human oversight, so potential mistakes they make can go unnoticed. Users then depend on the model to report what went wrong. An honest model discloses its…
36 -
AdaptEvo: Adaptive Agent Learning with Evolving Supervision
arXiv:2610.11354v1 Announce Type: new Abstract: Rule-governed contextual decision tasks require models to apply specified rules to case-specific context and evidence. Written rules can leave gaps in decision guidance and process evaluation, while reference judgments vary in…
11 -
SignRAG: Unified Retrieval-Augmented Gloss-Free Sign Language Translation
arXiv:2610.11371v1 Announce Type: new Abstract: Contemporary decoder-only large language models (LLMs) have demonstrated strong capabilities across a wide range of domains. However, existing pretraining paradigms for gloss-free sign language translation (SLT) are largely…
36 -
Fact over Fiction: Detection of Pathological Hallucinations in Sinhala-to-English Neural Machine Translation
arXiv:2610.11389v1 Announce Type: new Abstract: Neural Machine Translation (NMT) models, while capable of producing highly fluent outputs, remain vulnerable to hallucinations, which are translations that are natural yet semantically unrelated to the source. This vulnerability is…
31 -
BioBigBird: A Sparse Attention Model for Long-Range Dependency Processing in Biomedical Text
arXiv:2610.11430v1 Announce Type: new Abstract: While domain-specific Large Language Models (LLMs) have encoded vast biomedical knowledge, their limited context windows often hinder a deep understanding of nuanced relationships within and across texts. To address this…
25 -
Adversarial Cues in Decision Models Used as Judges: The Role of Request Presentation
arXiv:2610.11436v1 Announce Type: new Abstract: An answer judge instructed to grade the final commitment should reject an explicitly wrong final value even when an earlier value matches the reference. We show that adding one colon to a candidate can violate this requirement…
38 -
SAIL: Scientific Agentic Intelligence via a Science-Aware Loop
arXiv:2610.11451v1 Announce Type: new Abstract: We introduce SAIL, an open model with 35B total and 3B active parameters for literature research, scientific coding, and multi-step research workflows. SAIL is developed through a science-aware improvement loop: agents built on…
10 -
Beyond Sequences: Distilling Structured Decision Memory for LLM Recommendation
arXiv:2610.11501v1 Announce Type: new Abstract: Despite the adoption of large language models (LLMs) in recommendation systems, prevailing approaches mostly model single-type behaviors (e.g., views or purchases). Even when incorporating multiple behaviors, existing methods…
28 -
Does Modern Standard Arabic (MSA) Dominate Arabic Dialects in LLMs? A Representation-Level Analysis
arXiv:2610.11510v1 Announce Type: new Abstract: Large language models (LLMs) often default to Modern Standard Arabic (MSA) when generating Arabic, even when prompted with dialectal Arabic. A natural explanation is that their internal representations are dominated by MSA. We test…
12 -
Residual Advantage: Student-Relative Teacher Guidance for RL with Verifiable Rewards
arXiv:2610.11519v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) and on-policy distillation (OPD) have become two main paradigms for post-training reasoning models. RLVR gives each response a single outcome label, leaving the steps inside it…
6 -
When Can You Prune Your Network? A Study of Intermediate Neurons in Multilingual Speech Parsing
arXiv:2610.11520v1 Announce Type: new Abstract: End-to-end speech parsing, a task recently proposed, consists in predicting both the transcription and the syntactic tree for a spoken utterance. Existing architectures for speech parsing often utilise intermediate neural networks.…
18 -
Constitutional Gating and Deterministic Recovery for Multi-Agent LLM Negotiation: Ablations Against a Stateful Adversarial Gatekeeper
arXiv:2610.11542v1 Announce Type: new Abstract: Multi-agent LLM systems negotiating with a stateful counterpart waste model calls in three ways: polite loops that never meet the counterpart's hidden acceptance condition, malformed outputs that trigger retries, and compliance…
35 -
Learning the Loop, Not Just the Page: Execution-Grounded Loop Learning for Web Generation
arXiv:2610.11543v1 Announce Type: new Abstract: Functional Web generation is increasingly optimized with executable rewards, yet existing methods largely focus on the quality of the final page and leave the process of diagnosing and repairing imperfect implementations…
12 -
Prosody-to-Text: Predicting text from low-pass filtered speech
arXiv:2610.11544v1 Announce Type: new Abstract: While predicting prosody from text is an established task in the field, the opposite direction, predicting text that fits a given prosodic pattern, remains largely overlooked. We find this unfortunate, because this opposite…
20 -
SWE-Journey: Towards More Realistic Evaluation of Coding Assistants through Long-Horizon, Multi-Turn Interaction
arXiv:2610.11559v1 Announce Type: new Abstract: Coding assistants such as Claude Code and Codex have become a major application of LLM agents, yet existing benchmarks remain far from real-world use, particularly in task horizon and interaction length. Code assistants require…
35 -
Incremental Open-Ended Deep Research with Structured Harness
arXiv:2610.11566v1 Announce Type: new Abstract: Existing Open-Ended Deep Research (OEDR) systems primarily generate reports from scratch, making them inefficient for scenarios where research reports need to be continuously maintained as new information emerges. We introduce…
8 -
Smoothing the Top-k Exposure Boundary for Sparse Mixture-of-Experts
arXiv:2610.11575v1 Announce Type: new Abstract: Sparse Mixture-of-Experts models scale parameter capacity efficiently while maintaining a fixed compute budget per token. However, traditional training paradigms enforce a static choice of top-$k$ experts, which converts a…
4