News / #voice Tag Voice 500 articles archived under #voice · RSS Sign in to follow arXiv — NLP / Computation & Language research 1mo ago Test-Time Scaling for Scientific Equation Discovery arXiv:2608.28660v1 Announce Type: new Abstract: Test-time scaling (TTS) improves language model reasoning by allocating additional test-time compute, but prior work mainly studies closed-ended tasks such as math and coding. We study TTS for automated equation discovery, an… 31 arXiv — NLP / Computation & Language research 1mo ago No Detectable Change in Side-Level WER from Prompt-Level Context: A Preregistered Ablation on a Production Oral-History Corpus arXiv:2608.28875v1 Announce Type: new Abstract: Supplying context at inference time to a large multimodal model is an inexpensive lever for adapting speech transcription to a domain, and earlier results on smaller models reported large gains. This work tested that mechanism… 25 arXiv — NLP / Computation & Language research 1mo ago VoiceCodeBench: Evaluating Exact Structured-Token Recovery in Automatic Speech Recognition arXiv:2608.28916v1 Announce Type: new Abstract: Automatic speech recognition (ASR) systems are commonly evaluated with word error rate (WER), yet many voice workflows depend on exact written values for identifiers, paths, and measured quantities. A transcript can appear fluent… 31 arXiv — NLP / Computation & Language research 1mo ago VocalAffectBench: Evaluating Vocal Emotion Recognition in AI Audio Models arXiv:2608.28932v1 Announce Type: new Abstract: Voice products increasingly need affective cues that are present in speech but absent from transcripts. We introduce VocalAffectBench, a public, test-only benchmark for evaluating whether AI audio models can identify expressed… 16 arXiv — NLP / Computation & Language research 1mo ago HEAR Who Said What: Unlocking Speaker-Attributed Reasoning via Counterfactual Voice Grounding arXiv:2608.29120v1 Announce Type: new Abstract: Speech Language Models (SLMs) are increasingly deployed in multi-speaker environments, yet their ability to attribute speech to the correct speaker and reason over speaker identities remains unclear. Hence, we introduce HEAR, a… 30 arXiv — NLP / Computation & Language research 1mo ago Anchoring Speech with Semantics: A Multimodal Adapter Mechanism for Automatic Speech Recognition in Low-Resource Languages arXiv:2608.29239v1 Announce Type: new Abstract: Low-resource ASR remains difficult because scarce transcripts provide limited supervised evidence for target-side generation. To address this gap, we propose SAMA-ASR, a lightweight adapter mechanism that augments the decoder with… 36 arXiv — NLP / Computation & Language research 1mo ago When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions arXiv:2608.29241v1 Announce Type: new Abstract: Clinical voice agents are now deployed in routine care, where real patients do not wait their turn: they interrupt. These systems typically use a cascaded architecture (speech-to-text -> LLM -> text-to-speech), so when a patient… 17 TechCrunch — AI news-outlet 1mo ago Harvard Law dropout raises $6M for Blue Voice to build a ‘Harvey for police officers’ The seed round for the app that provides real-time legal and policy guidance to officers was led by SignalFire and Las Olas VC. 5 r/LocalLLaMA community 1mo ago pipecat-ai/phonellm-alpha-1: GPT 5.6 Terra performance on typical voice agent tasks at 1/3 the latency and 1/18 the cost   submitted by   /u/paf1138 [link]   [comments] 4 arXiv — NLP / Computation & Language research 1mo ago Sledgehammer or Scalpel? A Fine-grained Adaptive Framework for Implicit Hate Speech arXiv:2608.27462v1 Announce Type: new Abstract: Unlike explicit attacks with obvious profanity, implicit hate speech hides malice within seemingly compliant expressions through metaphors and contextual hints, making its detection in online content review challenging. While… 31 arXiv — NLP / Computation & Language research 1mo ago Predicting Turn-Taking Outcomes in Multi-Party Conversation: Interpretable Modelling of Speech and Gaze Dynamics with Interpersonal Closeness arXiv:2608.27988v1 Announce Type: new Abstract: Smooth speaker transitions are fundamental to effective conversation and rely on an interlocutor's ability to predict when to enter the conversation. This ability depends on accurately interpreting and expressing the verbal and… 11 arXiv — NLP / Computation & Language research 1mo ago A Shaky Voice Is Not Always a Dodge: Benchmarking Textual and Vocal Evasion Detection in Earnings Calls arXiv:2608.28040v1 Announce Type: new Abstract: Existing approaches to evasion detection in earnings calls focus on textual transcripts, treating evasion as a single-dimensional phenomenon. We argue that evasion in spoken communication is inherently multidimensional: beyond what… 17 arXiv — NLP / Computation & Language research 1mo ago Phoneme- and Word-Level Metrics Using Self-Supervised Speech Representations for Forced Alignment Evaluation arXiv:2608.28508v1 Announce Type: new Abstract: Forced alignment evaluation typically requires manually annotated timestamps, limiting large-scale and multilingual analysis. We introduce two corpus-level metrics based on self-supervised (SSL) speech representations for… 6 arXiv — NLP / Computation & Language research 1mo ago SURE-Challenge: Evaluating Speech Evidence Before Speech-LLM Generation arXiv:2608.27783v1 Announce Type: cross Abstract: Speech LLMs are usually graded after they answer, although an operating system first has to decide whether a waveform should be sent to the model. We define the Speech-Unsupported Rejection Evaluation Challenge (SURE-Challenge)… 33 arXiv — NLP / Computation & Language research 1mo ago Auditing Generative Audio Calls for Known-Task Audio-LLM Evaluation arXiv:2608.27817v1 Announce Type: cross Abstract: Speech and audio LLMs are often evaluated by asking whether a waveform prompt beats an automatic speech recognition (ASR) transcript. For known closed-set tasks, that comparison conflates two factors: access to acoustic evidence… 33 arXiv — NLP / Computation & Language research 1mo ago Is Prosody Lost in Translation? Fine-Grained Cross-Lingual Prosody Similarity Across Languages arXiv:2608.27848v1 Announce Type: cross Abstract: Prosody plays an important role in speech translation, conveying information such as emphasis, emotion, and intent beyond lexical content. However, despite recent progress in expressive speech-to-speech translation (S2ST), little… 4 arXiv — NLP / Computation & Language research 1mo ago When Robots Mishear Us: Mapping the Safety Risks of Voice-Controlled Embodied AI arXiv:2608.28518v1 Announce Type: cross Abstract: We investigate whether automatic speech recognition (ASR) errors in user input can lead to unsafe outputs from Embodied AI (EAI) models. We find that ASR errors can lead to harmful instructions being accepted and executed by EAI… 38 arXiv — NLP / Computation & Language research 1mo ago OmniFusion: Simultaneous Multilingual Multimodal Translations via Modular Fusion arXiv:2512.00234v3 Announce Type: replace Abstract: There has been significant progress in open-source text-only translation large language models (LLMs) with better language coverage and quality. However, these models can be only used in cascaded pipelines for speech… 5 Vercel — AI dev-tools 1mo ago Vercel Sandbox now calculates snapshot storage costs daily Vercel now calculates charges for Sandbox snapshot storage from each day’s average usage and adds them to your monthly invoice. Previously, billing used one average across the entire monthly billing period. You can track these daily charges on the team’s Usage page and see how… 22 r/LocalLLaMA community 1mo ago I fine-tuned a 0.8B local model for dictation cleanup. It matched a hosted frontier model on this narrow task I built SpeakoFlow Mini, an Apache-2.0 fine-tune of Qwen3.5-0.8B for dictation cleanup. It is not a chat model or a general rewriter. It takes speech-to-text output, applies corrections the speaker actually made, and leaves everything else alone. That last part is harder than it… 21 r/LocalLLaMA community 1mo ago Any current Voice2Voice AI model that runs locally that’s good? You guys remember sesame AI? With their really good AI voice model? Obviously ChatGPT has their voice model that’s also really good. Is there any smaller local variant that runs on like consumer grade gpu‘s (12,16 24gb?) I think NVidia released something but I didn’t really… 25 r/LocalLLaMA community 1mo ago Breeze-TTS-2 initial impressions: genuinely 'frontier' TTS You can test it out on breezblue's playground or use it locally, its only ~7GB.   submitted by   /u/Gohab2001 [link]   [comments] 20 llama.cpp releases dev-tools 1mo ago b10672 OpenVINO: Update OV to 2026.3.1, whisper.cpp support, Qwen3.5 on NPU, and new ops ( #27843 ) OpenVINO Backend: Fuse IM2COL + MatMul convolution into OpenVINO convolution ci:ggml-ov: Skip recurrent state rollback tests ci:ggml-ov: Skip recurrent state rollback tests Update… 33 r/LocalLLaMA community 1mo ago TontaubeV1 - Open TTS model release for local long-form generation Hey everyone, I am the co-founder of Tontaube. My brother and I just released TontaubeV1, a 2.9B-parameter open-weight TTS model focused on expressive speech, long-form generation, and low-latency local inference. The model is primarily aimed at English and German and supports… 36 arXiv — Machine Learning research 1mo ago Benchmarking_Fast_Domain_Adaptation_for_Unsupervised_Speech_Units arXiv:2608.26992v1 Announce Type: new Abstract: Representation learning has attracted great atten- tion and managed to reach good performances as a pretraining method for downstream tasks or as a first step towards unsu- pervised speech modeling. Yet, little is known about how… 4 arXiv — Machine Learning research 1mo ago Soft Active Electromyography Interface for Machine Learning-Enabled Silent Speech Recognition arXiv:2608.27048v1 Announce Type: new Abstract: Silent speech recognition (SSR) provides an alternative communication pathway in the absence of audible speech. However, conventional approaches are limited by the need for constant facial attachment, privacy concerns, and unstable… 33 arXiv — Machine Learning research 1mo ago Refusal Is Not Robustness: Auditing Confident Fabrication in Large Language Models on a Provably Uninformative Clinical Pain Speech Transcript arXiv:2608.26167v1 Announce Type: cross Abstract: Hallucination and abstention benchmarks rarely establish that a model could not have known the correct answer, making it difficult to distinguish appropriate abstention from an unsupported prediction. Seven large language models… 32 arXiv — NLP / Computation & Language research 1mo ago Training-Time Explainability for Multilingual Hate Speech Detection: Aligning Model Reasoning with Human Rationales arXiv:2608.26125v1 Announce Type: new Abstract: Online hate against Muslim communities often appears in culturally coded, multilingual forms that evade conventional AI moderation. Such systems, though accurate, remain opaque and risk bias, over-censorship, or under-moderation,… 17 arXiv — NLP / Computation & Language research 1mo ago Beyond Accuracy: A Qualitative Analysis of Vision-Language Models for Hate Speech Detection in Memes arXiv:2608.26143v1 Announce Type: new Abstract: Memes have turned out to be a powerful tool through which individuals share their ideas concerning contemporary social and political problems. Their anonymity, as well as their ability to go viral, make them a powerful medium for… 28 arXiv — NLP / Computation & Language research 1mo ago Vagdhenu: A Vrutta (Meter) Aware Shloka-to-Chant (TTS) System for Sanskrit arXiv:2608.26146v1 Announce Type: new Abstract: We present Vagdhenu, a vrutta (meter) aware shloka-to-chant system for Sanskrit: a text-to-speech system that maps a metrical verse to its chanted parayana recitation at high fidelity. This is an experience report, not a new… 33 arXiv — NLP / Computation & Language research 1mo ago Towards Interpretable Depression Detection: Linking Acoustic Features to DSM-5 Indicators arXiv:2608.26148v1 Announce Type: new Abstract: Depression affects millions worldwide, yet diagnosis relies on subjective self-reports that may miss authentic behavior. This paper presents an approach linking speech acoustics to DSM-5 depressive-behavior indicators through a… 26 arXiv — NLP / Computation & Language research 1mo ago A Reranker for Orchestrating Heterogeneous Speech and Text Retrievers arXiv:2608.26194v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) systems have attracted significant interest for their ability to mitigate hallucinations in Large Language Models (LLMs). Although knowledge databases for RAG are increasingly diversifying to… 16 arXiv — NLP / Computation & Language research 1mo ago AfriSwitch: A Benchmark for In-the-Wild African Code-Switched Speech Recognition arXiv:2608.26434v1 Announce Type: new Abstract: Code-switching is pervasive in bilingual African conversation, yet most ASR systems assume monolingual input and are evaluated on curated monolingual benchmarks. We present AfriSwitch, a 61.36-hour human-transcribed benchmark of… 22 arXiv — NLP / Computation & Language research 1mo ago Scaling phoneme-based TTS augmentation for ASR: A unified pipeline and controlled study arXiv:2608.26697v1 Announce Type: new Abstract: Synthetic speech provides scalable supervision for automatic speech recognition (ASR), but its benefit depends on the selected texts, reference speech, and amount of synthesized data. We present a unified phoneme-based TTS-to-ASR… 14 arXiv — NLP / Computation & Language research 1mo ago Mapping Written Words to Spoken Words in a Different Language Using Only Visual Grounding arXiv:2608.26925v1 Announce Type: new Abstract: In many low-resource settings, even just eliciting speech for data collection is difficult. One promising approach has been to ask speakers to describe images. But how do we build models from such visually grounded speech data?… 12 arXiv — NLP / Computation & Language research 1mo ago Said Aloud, Read Different: Cross-Modal Instability in Multimodal Models arXiv:2608.27135v1 Announce Type: new Abstract: Multimodal foundation models are increasingly used in speech-first assistants that must interpret spoken queries and produce visually grounded decisions. Yet it remains unclear whether semantically equivalent queries yield… 32 Hugging Face official-blog 1mo ago The Open ASR Leaderboard Adds Its First Global South Language Back to Articles a]:hidden"> The Open ASR Leaderboard Adds Its First Global South Language Published August 28, 2026 Update on GitHub Upvote 3 Eric Bezzam bezzam Shobhit Banga Shobhitbanga VoiceArena Manas Dhir manasdhir04 VoiceArena Bhaskar Singh bhaskarJT VoiceArena Manmeet… 34 Hugging Face Daily Papers research 1mo ago LibriBrain100: One Hundred Hours of Broad and Deep MEG Data for Neural Speech Decoding at Scale Abstract LibriBrain100 is a large-scale MEG speech dataset that demonstrates improved decoding through extensive within-subject recordings and multi-subject supervised fine-tuning of pre-trained models. Generated by thinkingmachines/Inkling-Small We introduce LibriBrain100, a… 12 Hugging Face Daily Papers research 1mo ago Super Star: Towards Streaming Real-time Interactive Agents for Digital Humans Abstract A real-time framework for online co-speech gesture generation uses a causal multimodal autoregressive model with streaming speech and motion history, supported by synthetic dialogue data and continual user-feedback adaptation. Generated by thinkingmachines/Inkling-Small… 13 Hugging Face Daily Papers research 1mo ago VoiceMem: Streaming Dual-Brain Memory for Real-Time Interaction Abstract VoiceMem introduces a dual-brain streaming memory architecture for speech language models that improves retrieval accuracy, emotional personalization, and real-time efficiency. Generated by thinkingmachines/Inkling-Small Conversational systems, such as duplex speech… 15 arXiv — NLP / Computation & Language research 1mo ago LibriBrain100: One Hundred Hours of Broad and Deep MEG Data for Neural Speech Decoding at Scale arXiv:2608.25204v1 Announce Type: cross Abstract: We introduce LibriBrain100, a large-scale MEG dataset for speech decoding designed from the ground up for reproducible, standardised evaluation. LibriBrain100 more than doubles the size of the original LibriBrain release,… 15 arXiv — NLP / Computation & Language research 1mo ago Leveraging Speech Acts for Low-Data and Cross-Domain Conversation Derailment Forecasting arXiv:2608.25359v1 Announce Type: new Abstract: Conversational derailment forecasting aims to predict when online discussions will escalate into hostility, enabling proactive moderation. Existing approaches often struggle in low-data settings and to generalize across domains.… 30 arXiv — NLP / Computation & Language research 1mo ago Generative vs. Encoder Large Language Models for ASR Evaluation: A Comparative Study arXiv:2608.25574v1 Announce Type: new Abstract: Automatic Speech Recognition (ASR) is typically evaluated using Word Error Rate (WER), which poorly reflects semantic similarity. While embedding-based metrics correlate better with human judgments, the respective roles of encoder… 23 arXiv — NLP / Computation & Language research 1mo ago From Specialization to Generalization: Instruction-tuned LLMs for Robust Harmful Content Mitigation arXiv:2608.25605v1 Announce Type: new Abstract: Large language models (LLMs) demonstrate impressive performance across a wide range of general NLP tasks; however, their effectiveness in sensitive domains, such as hate speech detection, remains less clear. Prior studies comparing… 25 arXiv — NLP / Computation & Language research 1mo ago Lost but not erased: Finding traces of a forgotten language in neural speech models arXiv:2608.25976v1 Announce Type: new Abstract: International adoptees retain phonological traces of a birth language they can no longer speak or comprehend, a persistence typically attributed to a biologically-timed critical period. We asked whether it could instead reflect the… 4 arXiv — NLP / Computation & Language research 1mo ago Fine-Tuning Whisper for Automatic Speech Recognition in Baniwa: A Preliminary Study arXiv:2608.26060v1 Announce Type: new Abstract: Automatic Speech Recognition (ASR) technologies have achieved remarkable performance in recent years through the use of large multilingual foundation models. However, most advances remain concentrated on high-resource languages,… 9 Ars Technica — AI news-outlet 1mo ago Google announces Gemini 3.5 Transcribe for AI-powered speech-to-text The AI that powers Gboard's Rambler is coming to more Google products, including Chrome. 23 Google DeepMind official-blog 1mo ago Intelligent transcription with Gemini 3.5 Transcribe Now you can get more intelligent speech-to-text transcription with Gemini 3.5 Transcribe. 21 VentureBeat — AI news-outlet 1mo ago Orchestration is the new challenge for CX in the age of AI agents Presented by Tata Communications Enterprises are deploying AI agents, voice AI, and automation across messaging, voice, and digital channels faster than the architecture meant to support it. Most of that deployment has involved attaching conversational AI to legacy systems never… 5 TechCrunch — AI news-outlet 1mo ago India’s Ringg gets backing from Peak XV as it pushes voice AI past the phone call Ringg has raised $10 million from Peak XV as a part of its Series A extension. 25 Page 8 of 10 · 500 articles ← Newer Older →
