arXiv — NLP / Computation & Language
500 articles archived · Visit source ↗ · RSS
-
arXiv — NLP / Computation & Language research 3d ago
MoganBert-TR: A Turkish Encoder Foundation Model Trained from Scratch with a CLM-to-MLM Curriculum
arXiv:2608.25768v1 Announce Type: new Abstract: Turkish encoder models have adopted modern architectures while leaving the pretraining objective fixed at masked language modelling. This paper introduces MoganBert-TR, a 149M-parameter Turkish encoder foundation model trained from…
16 -
Localize-Then-Decide Guarantees for LLM Judgments
arXiv:2608.25824v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as evaluators to assess output quality and preference alignment, yet providing reliable guarantees of agreement with human judgments remains challenging. Recent work introduces…
21 -
Unfolding Scientific Papers into Multi-Turn Generation Trajectories for Continued Pre-Training
arXiv:2608.25826v1 Announce Type: new Abstract: A recent line of synthetic-data work reconstructs the thinking behind existing text rather than rewriting the text itself, but it operates on short web passages, recovers only local thoughts, and leaves the structure of whole…
12 -
Skill Issue: Are Skills Language-Invariant in LLMs?
arXiv:2608.25832v1 Announce Type: new Abstract: Large language models access knowledge inconsistently across languages, but to what extent do they differ in their skill sets when interacting with different languages? This work quantifies cross-lingual skill inconsistency…
38 -
Key Point Analysis Needs Structure Recovery: Task Definition, Dataset Diagnosis, and a Structure-Aware Benchmark
arXiv:2608.25854v1 Announce Type: new Abstract: Key Point Analysis (KPA) aims to identify a concise set of key points that summarize a collection of arguments together with their prevalence. We argue that KPA is fundamentally a structured prediction problem that requires…
32 -
Anchoring Bias in LLM-as-a-Judge Systems: Prior Scores Compromise Evaluation Independence
arXiv:2608.25869v1 Announce Type: new Abstract: Large language models (LLMs) increasingly assess generated content, giving rise to the LLM-as-a-Judge paradigm. These systems now score outputs, filter content, and gate iterative refinement in production pipelines, where each…
21 -
Loss-Based Active Learning for Neural Abstractive Summarization
arXiv:2608.25881v1 Announce Type: new Abstract: Fine-tuning abstractive summarization models requires high-quality annotated data. However, obtaining such corpora is expensive and time-consuming, as it requires human annotators to read and comprehend long documents to create…
8 -
From Passive Response to Proactive Correction: Enhancing LLM Robustness Against Input Fact Perturbations
arXiv:2608.25894v1 Announce Type: new Abstract: Large language models (LLMs) frequently produce confident yet factually incorrect responses when user inputs contain misleading premises, a phenomenon we attribute to fact perturbations in the input. Existing approaches to…
4 -
One Form to Transfer Them All: Pretraining Multilingual Language Models Beyond Native Orthography
arXiv:2608.25904v1 Announce Type: new Abstract: Multilingual language models transfer knowledge across languages through shared subword vocabulary, a mechanism that breaks down when related languages use different writing systems. Prior work addresses this via script…
24 -
SAMpLE: A SystemC-AMS Machine LEarning-based Framework for Virtual Prototyping
arXiv:2608.25910v1 Announce Type: new Abstract: Machine Learning (ML) is increasingly used in virtual prototypes of embedded systems to model behaviors that are difficult to capture analytically. However, integrating ML models into virtual platform simulation is still typically…
21 -
Query-Side Attacks on GNN-Based KGQA: Tracing Failures from Entity Linking to Answer Generation
arXiv:2608.25922v1 Announce Type: new Abstract: GNN-based Knowledge Graph Question Answering (KGQA) pipelines process queries through four discrete stages: entity linking, subgraph retrieval, GNN reasoning, and answer generation. Standard robustness evaluations conflate…
15 -
Unveiling Spectral Mechanisms in Training-Free LLM Text Detection
arXiv:2608.25944v1 Announce Type: new Abstract: The rapid advancement of Large Language Models (LLMs) makes it increasingly difficult to distinguish human writing from machine-generated text. Training-free detection offers a scalable solution, yet common confidence-based metrics…
27 -
Lost but not erased: Finding traces of a forgotten language in neural speech models
arXiv:2608.25976v1 Announce Type: new Abstract: International adoptees retain phonological traces of a birth language they can no longer speak or comprehend, a persistence typically attributed to a biologically-timed critical period. We asked whether it could instead reflect the…
4 -
When Personality Meets Quantization: A Layer-wise MBTI Analysis of Quantized LLMs
arXiv:2608.25977v1 Announce Type: new Abstract: Personality is increasingly important in large language models (LLMs), as it shapes users' trust, engagement, and emotional experiences. While the Myers--Briggs Type Indicator (MBTI) has emerged as a common framework for assessing…
22 -
Distinct dynamics of conceptual and referential disruptions in human reading and large language model processing
arXiv:2608.25999v1 Announce Type: new Abstract: Linguistic meaning is grounded in conceptual content, from which reference to particular entities emerges as words enter discourse. To examine the processing dynamics associated with these two dimensions of meaning, we selectively…
7 -
VISA: Agentic Self-Evolving Data Synthesis for Multimodal Instruction Following
arXiv:2608.26013v1 Announce Type: new Abstract: Multimodal instruction-following models require training data that is accurate, diverse, verifiable, and challenging. Existing synthesis pipelines typically follow a one-pass generate-and-filter paradigm, discarding feedback from…
7 -
Beyond Local Surprise: Grounded Dialogue as Selective Belief Revision under Referential Uncertainty
arXiv:2608.26035v1 Announce Type: new Abstract: When a speaker refers to a scene that the listener cannot directly see, the listener must decide whether to preserve its current understanding or revise it as new utterances arrive. Many language systems treat local mismatch as a…
16 -
Fine-Tuning Whisper for Automatic Speech Recognition in Baniwa: A Preliminary Study
arXiv:2608.26060v1 Announce Type: new Abstract: Automatic Speech Recognition (ASR) technologies have achieved remarkable performance in recent years through the use of large multilingual foundation models. However, most advances remain concentrated on high-resource languages,…
9 -
Prefix Sliding for efficient test-time scaling
arXiv:2608.26070v1 Announce Type: new Abstract: Test-time scaling uses extra test-time compute to improve performance, such as letting language models reason longer when solving a problem. As models keep the entire reasoning trace in memory via full attention, hard tasks that…
26 -
Natural Language Input, Semantic Track Representation, and LLM Inference: Making the Maritime Information Exchange Model Tractable
arXiv:2608.24892v1 Announce Type: cross Abstract: We describe a practical architecture for making the Maritime Information Exchange Model (MIEM) and the broader Rich Semantic Track model tractable using current large language model (LLM) technology. The barrier to adoption of…
19 -
PA-CoT: Profile-Adaptive Chain-of-Thought for Personalized Nutritional Consulting
arXiv:2608.24907v1 Announce Type: cross Abstract: In health and nutrition consulting, widely used prompting methods pass the user profile as an unstructured block without a dedicated analysis step, leaving personalization as a critical structural gap. We introduce PA-CoT…
6 -
GreenLeaf Law Embed Tiny: A Compact Embedding Model for Legal Domain Retrieval
arXiv:2608.24936v1 Announce Type: cross Abstract: We present GreenLeaf Law Embed Tiny, a 0.6B parameter embedding model for legal domain retrieval. GreenLeaf-Tiny achieves 75.11% on the Massive Legal Embedding Benchmark (MLEB) and 64.38% on MTEB(Law, v1),demonstrating…
14 -
Demystifying Reinforcement Learning Post-Training of Language Models
arXiv:2608.24949v1 Announce Type: cross Abstract: Reinforcement learning (RL) post-training has emerged as a powerful framework for enhancing the capabilities of large language models (LLMs), enabling impressive reasoning, math, and coding capabilities. Yet for many researchers…
15 -
Can We Read the Mind of an Audio LLM? A Verbalizable, Multilingual Middle-Layer Workspace
arXiv:2608.24958v1 Announce Type: cross Abstract: An audio language model is a black box in a specific way: we see what it says, never what it works out on the way there, and chain-of-thought monitoring helps only if the model writes its reasoning down. Reading a base Qwen3-Omni…
8 -
Retrieved But Not Reliable: A Survey on Attacks, and Defenses in Retrieval-Augmented Generation
arXiv:2608.24977v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) enhances large language models by grounding outputs in external knowledge, improving factuality and reducing hallucinations. At the same time, the retrieval-augmented pipeline introduces new…
32 -
FrontierChallenge: Evaluating Scientific Workflow Completion
arXiv:2608.24979v1 Announce Type: cross Abstract: Scientific agents increasingly analyze data, execute code, and produce research artifacts, yet most benchmarks emphasize final answers, isolated programs, or a single domain. We introduce FrontierChallenge, a cross-domain…
11 -
Retrieve, Match, Escalate: Accurate and Scalable Product Linking with VLM-Distilled Cross-Encoders and Agentic VLMs
arXiv:2608.25037v1 Announce Type: cross Abstract: Product linking, the entity-resolution task of mapping merchant product records to canonical catalog products, consolidates fragmented listings so downstream search, recommendation, and advertising see one clean entry per…
19 -
RefLAM: A Reference-Grounded Line Annotation Pipeline for Historical Arabic Manuscripts
arXiv:2608.25140v1 Announce Type: cross Abstract: Existing approaches to building line-level Arabic handwritten-text-recognition (HTR) training data either rely on fully manual annotation, which does not scale, or on automatic OCR-to-reference alignment methods not yet extended…
33 -
Learning Mixtures of Plackett-Luce Models for Multi-Objective Alignment
arXiv:2608.25200v1 Announce Type: cross Abstract: We consider the problem of learning a mixture of $k$ Plackett-Luce models given multi-way ranking responses from annotators that may represent heterogeneous underlying preferences. This problem has many applications in AI…
30 -
LibriBrain100: One Hundred Hours of Broad and Deep MEG Data for Neural Speech Decoding at Scale
arXiv:2608.25204v1 Announce Type: cross Abstract: We introduce LibriBrain100, a large-scale MEG dataset for speech decoding designed from the ground up for reproducible, standardised evaluation. LibriBrain100 more than doubles the size of the original LibriBrain release,…
15 -
TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue
arXiv:2608.25218v1 Announce Type: cross Abstract: Speakers in natural conversation take turns speaking and listening, deciding in real time when to take, hold, or yield the floor. However, turn-taking evaluation remains limited due to the lack of a consistent, linguistically…
14 -
Trust the Mass: Forced Weights in KV-Cache Eviction
arXiv:2608.25230v1 Announce Type: cross Abstract: Every deployed sparse-attention or KV-cache-eviction rule keeps a subset of the keys, discards the rest, and renormalizes the attention weights over the kept set. Enumerating the exact best subset under that constraint on…
36 -
Output Dilution: Redundant but Fragile Representations in MoE Models
arXiv:2608.25231v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) models appear to encode moral content as robustly as dense models, yet prove far more fragile in their encoding. In OLMoE-1B-7B, linear probes recover moral valence from nearly every expert-layer…
27 -
Rare Diseases, Common Dilemmas: LLMs Prioritize Equal Resource Distribution over Patient Benefit in Decision-Making
arXiv:2608.25236v1 Announce Type: cross Abstract: Clinical decision-making often involves prioritizing ethical values, such as beneficence, non-maleficence, respecting a patient's autonomy, and justice. Recent work has begun to assess how large language models (LLMs) make such…
12 -
The "Curse of Knowledge" in LLM Query Simulation: Concept Provenance for Tracing Answer-Side Intrusion
arXiv:2608.25245v1 Announce Type: cross Abstract: LLM-generated search queries are widely used to augment IR evaluation, yet they may contain concepts that presuppose answer-side document knowledge, violating the information-access boundary of pre-search users. Existing…
25 -
FinRiskAtlas: Decision-Aligned Evaluation of Large Language Models for Financial Risk Review
arXiv:2608.25325v1 Announce Type: cross Abstract: Deploying large language models for professional financial review requires more than measuring general financial competence: models must perform the specific review operation required by a workflow and determine whether available…
38 -
Learning What to Share and What to Personalize: Hierarchical Strategy Co-Evolution for Agent Memory
arXiv:2608.25329v1 Announce Type: cross Abstract: Memory-augmented agents maintain compact user profiles throughout extended conversations, enabling personalized and consistent responses without the need to process the entire dialogue history. The quality of these user profiles…
5 -
Escaping Low-Dimensional Overlap: Multi-Task Model Merging via High-Dimensional Sparse Disentanglement
arXiv:2608.25354v1 Announce Type: cross Abstract: Model merging provides an efficient way to construct multi-task generalist models without additional training, but its performance often degrades under severe task interference. Task interference in model merging primarily stems…
17 -
GGSS: Geodesic-Gated Spherical Steering for Inference-Time Debiasing of Generative Vision-Language Models
arXiv:2608.25375v1 Announce Type: cross Abstract: Generative vision-language models (VLMs) are increasingly used in human-centered settings, yet they can produce demographically biased outputs even when images differ only in controlled attributes such as perceived race or…
7 -
PonsRAG: A Pons-Inspired RAG Bridging Cognitive Islands for Coordinated Long Narrative Reasoning
arXiv:2608.25486v1 Announce Type: cross Abstract: Long Narrative Reasoning is an essential capability for processing and reasoning over complex narratives. While retrieval-augmented generation provides a promising framework, existing methods still face two critical challenges:…
27 -
A Storage-Retrieval Gap in Parametric Knowledge Graph Memory
arXiv:2608.25489v1 Announce Type: cross Abstract: Graph retrieval-augmented generation places retrieved subgraphs into the model's context window at query time, paying a recurring token cost and exposing source data on every call. We study an alternative: compiling a knowledge…
21 -
CaSKG: Counterfactual-Causal Skill Graphs for Scalable Agent Skill Retrieval
arXiv:2608.25500v1 Announce Type: cross Abstract: Reusable skill libraries allow large language model (LLM) agents to reuse procedural knowledge across tasks, but they also turn memory access into a challenging retrieval problem. Full-library prompting preserves coverage at high…
25 -
Conditional Total Correlation and the Serial Depth of Adaptive Parallel Sampling
arXiv:2608.25505v1 Announce Type: cross Abstract: Motivated by parallel decoding in masked diffusion models, we study adaptive parallel sampling of discrete vectors: in each round, a deterministic policy selects unrevealed coordinates on the basis of the values observed so far,…
14 -
Reflection Steering: Disentangling Reflection from Reasoning in Activation Space for Token-Efficient Inference
arXiv:2608.25542v1 Announce Type: cross Abstract: Large reasoning models often produce reasoning traces with verification, revision, and backtracking. When reflection merely re-checks established results, it wastes reasoning tokens and increases latency. Most existing reflection…
18 -
When Stale Constraints Go Unchecked: Budgeted Verification Failures in Inherited Agent Memory
arXiv:2608.25553v1 Announce Type: cross Abstract: An agent that inherits a consolidated memory may inherit a constraint that was true when written and has since been withdrawn by a newer authoritative record. Under a scarce verification budget, does the agent recover the…
10 -
Plans You Can Check: Verifier-Grounded Learning of an Open-Weight Planner for Executable Video-Editing
arXiv:2608.25622v1 Announce Type: cross Abstract: Practical video editing is not only pixel generation: an editor must turn a brief, a clip pool, music metadata, and hard constraints into an executable timeline. We study this decision layer as \emph{executable video-editing…
32 -
A Token-Level Analysis of Sampled-Token Reverse-KL On-Policy Distillation
arXiv:2608.25643v1 Announce Type: cross Abstract: On-policy distillation (OPD) supervises a student on its own trajectories with token-level signals from a frozen teacher, yet how a sampled loss allocates updates across tokens remains poorly understood. We analyze the gradient…
29 -
Why Does Graph Learning Fail to Fully Benefit from a Text Teacher?
arXiv:2608.25741v1 Announce Type: cross Abstract: Graph neural networks (GNNs) are widely used to represent complex interactions and relationships among entities. We investigate a multimodal model that combines two complementary ideas: a self-supervised method that enables a GNN…
27 -
Formal, Executable and Explainable Runtime Monitoring of Spoken Air Traffic Control Operational Procedures
arXiv:2608.25926v1 Announce Type: cross Abstract: Air traffic control procedures are executed through spoken exchanges between controllers and pilots. These interactions are essential to the safety of air transportation: failures in their execution can create severe operational…
21 -
Code World Model: Coding Agent as World Brain
arXiv:2608.25927v1 Announce Type: cross Abstract: World models aim to simulate how complex environments evolve under actions and events, yet existing video-based world models primarily learn dynamics from visual observations, which reveal outcomes rather than the underlying…
16