News / #voice Tag Voice 500 articles archived under #voice · RSS Sign in to follow Hugging Face Daily Papers research 1mo ago StepAudio 3 Gen Technical Report Abstract StepAudio 3 Gen is a discrete autoregressive audio generation model using residual vector quantization tokens to unify text-to-speech, voice design, sound effects, and music within a single framework. Generated by thinkingmachines/Inkling-Small We introduce StepAudio 3… 20 arXiv — Machine Learning research 1mo ago TokenMapper: A Step Toward Interoperable Speech Token Translation arXiv:2609.12563v1 Announce Type: new Abstract: Neural audio codecs discretize speech into token sequences, but the resulting token spaces differ in vocabulary and codebook structure, preventing direct communication across models. This limitation affects applications such as… 5 arXiv — NLP / Computation & Language research 1mo ago What Counts as a Mistake? Annotating Recitation Events in Quran Memorization Transcripts arXiv:2609.12085v1 Announce Type: new Abstract: Checking Quran recitation from an ASR transcript requires distinguishing unresolved mistakes from repetitions, repairs, opening formulas and accepted spelling differences. We report a completed human annotation of 100 production… 8 arXiv — NLP / Computation & Language research 1mo ago Quantifying Consonant Contributions to Word Intelligibility via Acoustic Masking arXiv:2609.12122v1 Announce Type: new Abstract: Consonants contribute unequally to whether a word is understood. Given the limited time available for therapy, ranking consonants by contribution to intelligibility helps prioritize intervention targets in motor speech disorders.… 5 arXiv — NLP / Computation & Language research 1mo ago Not All Speech Is Intent: Adaptive Self-Correcting Inference Layer for Post-ASR False Wake-Up arXiv:2609.12469v1 Announce Type: new Abstract: False wake-up activations remain a persistent challenge in conversational AI. Speech phonetically similar to a device's wake word can produce a syntactically valid and semantically coherent ASR transcript that the assistant… 7 arXiv — NLP / Computation & Language research 1mo ago DuplexDrama: A Synthesized Dialogue Dataset with Scenarios, Full-Duplex Behaviors, Expressive Speech, and Sound Events arXiv:2609.12872v1 Announce Type: new Abstract: We present DuplexDrama, the first synthesized spoken dialogue dataset that simultaneously covers four dimensions: (i) complete persona and scenario settings; (ii) three full-duplex behaviors (interruption, backchannel, incomplete);… 38 arXiv — NLP / Computation & Language research 1mo ago Kraken: LLM-based Speech-to-Speech Translation via Low-bitrate VQ and Dual-path Source Conditioning arXiv:2609.13045v1 Announce Type: new Abstract: Speech-to-speech translation (S2ST) has advanced significantly with speech LLMs, offering the potential for joint optimization and preserving non-linguistic information. However, these models struggle with predicting high-bitrate… 27 arXiv — NLP / Computation & Language research 1mo ago Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agents arXiv:2609.13117v1 Announce Type: new Abstract: Full-duplex evaluation often emphasizes whether an agent keeps speaking or stops. That binary cannot express a third response humans use routinely: continuing to speak while incorporating what the listener just contributed. The… 38 arXiv — NLP / Computation & Language research 1mo ago SteerDuplex: Steerable Duplex Speech Dialogue Models arXiv:2609.12623v1 Announce Type: cross Abstract: Full-duplex spoken dialogue models support low-latency turn taking, interruption handling, and backchanneling, yet a key capability remains underexplored: steerability, the ability to reliably shift conversational behavior along… 15 arXiv — NLP / Computation & Language research 1mo ago MP-Bench: Evaluating Voice Agents as a Multiparty Conversation Participant arXiv:2609.13076v1 Announce Type: cross Abstract: Conversational voice agents have advanced significantly, offering increasingly natural human-machine interactions through both cascaded and end-to-end architectures. However, while recent benchmarks extensively evaluate dyadic… 7 arXiv — NLP / Computation & Language research 1mo ago GeoSense-AI: Fast Location Inference from Crisis Microblogs arXiv:2512.18225v2 Announce Type: replace Abstract: This paper presents an applied AI pipeline for real-time geolocation from noisy microblog streams, unifying statistical hashtag segmentation, part-of-speech-driven proper-noun detection, dependency parsing around disaster… 24 arXiv — NLP / Computation & Language research 1mo ago False positive bias in AI-powered speech-based cognitive screening for multilingual English speakers in the UK arXiv:2602.13047v3 Announce Type: replace Abstract: Conversational speech reveals early signs of cognitive decline, including dementia and mild cognitive impairment (MCI). AI models show promise for speech-based screening, yet most research focuses on monolingual groups. In the… 28 r/LocalLLaMA community 1mo ago tencent/AuK-Flash · Hugging Face AuK-Flash: Fast 4-Step Speech Generation and Editing arXiv : https://arxiv.org/abs/2609.08936 Full Paper : https://arxiv.org/pdf/2609.08936 GitHub : https://github.com/Tencent-Hunyuan/AuK Project : https://auk-project.github.io/ Introduction AuK is a 1.5B foundation model for… 28 r/LocalLLaMA community 1mo ago Orukeet, new ASR model based on Parakeet I haven't seen this mentioned yet, so I thought it deserves a post. I was trying out OpenWhispr when this model came up as the recommendation. So I don't have personal experience yet, but it's supposed to be a better version of Parakeet, especially on Macs. Their official… 6 MIT News — AI research 1mo ago Lifesaving Lincoln Laboratory device wins 2026 Excellence in Technology Transfer Award The handheld catheterization device AI-GUIDE, created by Lincoln Laboratory and Massachusetts General Hospital, promises improved health outcomes for injured service members and civilians. 9 r/LocalLLaMA community 1mo ago GPT Live clone on an RTX 3060 I wanted to see how my fully local home voice assistant compared to the latest GPT Live, so I tested it using the same conversation used in their "Improved Intelligence" demo . In this video they ask the AI to see if a flight route is feasible and while it is figuring that out… 6 Hugging Face Daily Papers research 1mo ago X-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation Abstract X-AuT progressively prunes audio-encoder layers in speech large language models and restores accuracy via behavioral probes, representation alignment, cross-scale distillation, and LoRA adaptation. Generated by thinkingmachines/Inkling-Small Reducing audio-encoder depth… 28 arXiv — NLP / Computation & Language research 1mo ago LLM-Anchored Paralinguistic Enrichment for Alzheimer's Disease Detection arXiv:2609.10896v1 Announce Type: new Abstract: Speech-based automatic detection of Alzheimer's disease (AD) provides a non-invasive and scalable approach to early cognitive screening. AD affects both lexical-semantic organization and speech production, including atypical pauses… 23 arXiv — NLP / Computation & Language research 1mo ago Assessing the Reusability of Public Speech Resources for Low-Resource Languages: A Central Kurdish Case Study arXiv:2609.11246v1 Announce Type: new Abstract: Kurdish is spoken by millions of people, but little technology can read it aloud. A recent study released three Kurdish voices, 35 hours of recorded speech, and a paper describing the work, all free to download. This review checks… 9 arXiv — NLP / Computation & Language research 1mo ago Automatic Lyric Transcription for Greek Songs: Scaling and Task Composition Effects in Whisper Adaptation arXiv:2609.11302v1 Announce Type: new Abstract: Automatic Lyric Transcription (ALT) remains substantially more challenging than speech recognition due to melodic variability, rhythmic irregularity, and accompaniment interference. This is heightened in low-resource languages like… 22 arXiv — NLP / Computation & Language research 1mo ago SEAR: Segment-Evidence-Aware Routing for Weak-to-Strong Multilingual Speech MCQ arXiv:2609.11355v1 Announce Type: new Abstract: This paper describes our system for Task~2 of the second Multilingual Conversational Speech Language Model (MLC-SLM) Challenge. We adapt Qwen3-Omni-30B-A3B-Instruct with a segment-evidence-aware data and post-training pipeline. A… 25 arXiv — NLP / Computation & Language research 1mo ago Complex-Text Robustness Evaluation and Failure Diagnosis for Low-Resource Multilingual Text-to-Speech arXiv:2609.11545v1 Announce Type: new Abstract: Low-resource multilingual text-to-speech (TTS) systems have expanded language coverage, but their robustness under complex text inputs remains insufficiently diagnosed. Existing evaluations mainly focus on naturalness, speaker… 37 arXiv — NLP / Computation & Language research 1mo ago The Eloquence submission for Task 2 of the Interspeech 2026 MLC-SLM challenge arXiv:2609.11724v1 Announce Type: new Abstract: This paper details the Eloquence team's approach to Task 2 of the 2nd MLC-SLM challenge at Interspeech 2026, which involves multilingual Multiple-Choice Question Answering (MCQA) across 21 languages. Three approaches are explored.… 30 arXiv — NLP / Computation & Language research 1mo ago Component-Aware Differential Privacy for Federated Multilingual Speech-LLMs arXiv:2609.11762v1 Announce Type: new Abstract: Per-layer differential privacy (DP) clipping improves gradient fidelity in federated learning by allocating per-matrix clipping budgets proportional to parameter count. We show that this recipe breaks for speech large language… 13 arXiv — NLP / Computation & Language research 1mo ago Beyond Word Error Rate: A Switch Aware Evaluation of ASR and Audio Language Models on English Yoruba Code-Switched Speech arXiv:2609.11786v1 Announce Type: new Abstract: Automatic speech recognition (ASR) systems and audio language models (audio LMs) now report low error rates on monolingual benchmarks, but their behavior on code switched speech in low resource, diacritic rich languages remains… 33 arXiv — NLP / Computation & Language research 1mo ago Epistemic orientation predicts legislative effectiveness among members of the US Congress arXiv:2609.11865v1 Announce Type: new Abstract: Truth and evidence-based communication provide important foundations for democratic governance, accountability, and collective decision-making. Prior work shows that evidence-oriented language in US congressional floor speeches has… 10 arXiv — NLP / Computation & Language research 1mo ago Nuha-Speech: Building General-Purpose Arabic Speech-LLMs arXiv:2609.11892v1 Announce Type: new Abstract: As Speech Large Language Models (speech-LLMs) become increasingly multilingual, Arabic remains significantly underrepresented, highlighting the need for dedicated infrastructure to train and evaluate Arabic speech-LLMs. To address… 14 arXiv — NLP / Computation & Language research 1mo ago A Voice-Interactive Multi-Agent System for Smart Operating Rooms: Architecture Design and Key Technologies arXiv:2609.11231v1 Announce Type: cross Abstract: This paper presents SurgicalRoomAgent, a voice-interactive multi-agent system for smart operating rooms based on large language models (LLMs). The system achieves natural language understanding, device control, intraoperative… 12 arXiv — NLP / Computation & Language research 1mo ago Xiaomi-CocktailASR-1 Technical Report arXiv:2609.11274v1 Announce Type: cross Abstract: Recently, large language model (LLM) based ASR models have achieved significant progress, yet they generally lack support for multi-speaker scenarios, where the cocktail party problem remains a critical bottleneck for further… 4 arXiv — NLP / Computation & Language research 1mo ago Whisper-Based Speech Transcription from Videos Across Multiple Languages for Cross-Cultural Understanding arXiv:2609.11772v1 Announce Type: cross Abstract: Cross-cultural understanding has become increasingly important in today's highly connected, cross-national world. The success of LLM-based technologies is now driving the development of automated tools to aid understanding for… 38 arXiv — NLP / Computation & Language research 1mo ago RetroThinker: Enabling Retrospective Thinking in Speech LLMs arXiv:2609.11864v1 Announce Type: cross Abstract: Speech large language models (SpeechLLMs) offer reduced latency and retain paralinguistic nuances that are typically lost in cascaded automatic speech recognition (ASR) and text-based LM architectures. However, they continue to… 7 arXiv — NLP / Computation & Language research 1mo ago Leveraging LLMs for Context-Aware Implicit Textual and Multimodal Hate Speech Detection arXiv:2510.15685v2 Announce Type: replace Abstract: This paper investigates the use of an LLM to generate auxiliary background context for social media posts, and explores four methods to incorporate this context into the input of an SBERT-based Hate Speech Detection (HSD)… 28 The Information — AI news-outlet 1mo ago Microsoft, Hurt By Server Shortage, Aims to Triple Cloud Capacity by 2032 Microsoft is planning to more than triple the size of its Azure cloud unit’s data center capacity to over 38 gigawatts by 2032, up from 12 gigawatts today, Bloomberg reported Thursday. A gigawatt of capacity would be able to power a city the size of San Francisco. The planned… 16 r/LocalLLaMA community 1mo ago LoudKit: local TTS with voice cloning, 10 languages, and SDKs for Python, Swift, Go, Rust and TypeScript hey guys, I've been working on a reading app for several months now and had problems with getting good quality TTS, the options were kokoro, kitten, pocket but all of them even though they were sounding natural had some problems when listening longer. Last month I took upon… 14 Hugging Face Daily Papers research 1mo ago The Semantic Bottleneck: Leveraging Semantic Representations for Non-Invasive Speech Decoding Abstract A non-invasive brain decoding approach maps MEG responses to semantic embeddings to reconstruct sentence-level text without requiring word-level alignment. Generated by thinkingmachines/Inkling-Small Non-invasive speech decoding remains constrained by the low… 34 MIT Technology Review — AI news-outlet 1mo ago Powering AI is an architecture problem On July 22, 2026, a transmission line fault in Ashburn, Virginia—the heart of the world’s largest data center cluster—knocked more than 3 gigawatts of load off the grid in seconds. And it wasn’t the first time. Two years earlier, a single failed surge arrester… 36 r/LocalLLaMA community 1mo ago What TTS models do you recommend as today? Trying to get Hermes a local, efficient, tts voice.   submitted by   /u/JLeonsarmiento [link]   [comments] 8 arXiv — NLP / Computation & Language research 1mo ago The Mutations of Machine Speech arXiv:2609.09496v1 Announce Type: new Abstract: Algorithmic outputs now populate the digital environments through which contemporary life is organized. The role of law in facilitating and constituting (rather than merely responding to) these processes is gaining increasing… 25 arXiv — NLP / Computation & Language research 1mo ago BuzzASR: A Swarm of 100+ Monolingual Speech Recognition Models arXiv:2609.09554v1 Announce Type: new Abstract: We introduce BuzzASR, a collection of language-specialized fine-tuned Whisper models adapted for automatic speech recognition (ASR) in 102 languages. Large end-to-end Transformer-based ASR models such as Whisper have revolutionized… 37 arXiv — NLP / Computation & Language research 1mo ago SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asia arXiv:2609.09672v1 Announce Type: new Abstract: The rapid advancement of audio and multimodal large language models has unlocked transformative speech understanding capabilities, yet evaluation frameworks remain predominantly English-centric, leaving Southeast Asian (SEA)… 22 arXiv — NLP / Computation & Language research 1mo ago X2-NativeCursor: Native-Token Text Progress Tracking for Incremental-Text Streaming Codec TTS arXiv:2609.09677v1 Announce Type: new Abstract: Incremental-text streaming text-to-speech (TTS) needs online text progress tracking for synchronized highlighting, interruption handling, and dialogue-history updates. Input text arrives before it is spoken, so text arrival alone… 37 arXiv — NLP / Computation & Language research 1mo ago StreamAlign: Streaming Text-Aligned Speech Tokenization arXiv:2609.09719v1 Announce Type: new Abstract: Text-aligned speech tokenization methods have emerged to better align speech tokens with LLM token spaces, enabling more effective utilization of pretrained LLMs. However, they rely on offline automatic speech recognition (ASR),… 29 arXiv — NLP / Computation & Language research 1mo ago MUCnoHARM@GermEval Shared Task 2026: Retrieval-based In-Context Learning for Defamatory Offences, and Where It Falls Short arXiv:2609.09791v1 Announce Type: new Abstract: With hate speech being ubiquitous online, automatic detection is crucial, in particular when it comes to criminally relevant social media posts. We study a variety of retrieval-based in-context learning (RetICL) strategies for… 26 arXiv — NLP / Computation & Language research 1mo ago $S^3$-Bench: Evaluating Speech Interaction Models as Scientific Voice Assistants arXiv:2609.09852v1 Announce Type: new Abstract: The advance of multimodal large language models (MLLMs) has fundamentally reshaped the paradigm of human-computer interaction, especially speech interaction models capable of seamless conversations. Despite remarkable performance… 5 arXiv — NLP / Computation & Language research 1mo ago Leveraging Fine-grained Error Correction in Korean Speech Recognition for Consultation Services arXiv:2609.09889v1 Announce Type: new Abstract: Automatic Speech Recognition (ASR) technology is fundamental to customer service automation and large-scale transcription. However, even advanced ASR models exhibit inevitable errors in complex real-world environments such as call… 37 arXiv — NLP / Computation & Language research 1mo ago The Semantic Bottleneck: Leveraging Semantic Representations for Non-Invasive Speech Decoding arXiv:2609.10296v1 Announce Type: new Abstract: Non-invasive speech decoding remains constrained by the low signal-to-noise ratio of neural recordings, which makes fine-grained reconstruction of phonemes or individual words difficult. Motivated by neuroscientific evidence that… 26 arXiv — NLP / Computation & Language research 1mo ago Do speech foundation models really learn words? arXiv:2609.10434v1 Announce Type: new Abstract: Self-supervised speech foundation models are now used in a wide array of downstream applications, including traditional speech recognition and as the basis for tokens in speech-aware language models. Attempts to understand their… 35 arXiv — NLP / Computation & Language research 1mo ago Who Are They to Each Other? Multi-Agent Reasoning for Speaker Relationship Inference arXiv:2609.09628v1 Announce Type: cross Abstract: Inferring speaker relationships from spoken conversations is an important step towards socially aware speech understanding. However, this task remains underexplored, and supervised modeling is costly to train and scale. At the… 24 arXiv — NLP / Computation & Language research 1mo ago Deterministic Prompting for Speaker-Stable Low-Resource Greek TTS arXiv:2609.10022v1 Announce Type: cross Abstract: Modern TTS systems approach human quality for high-resource languages but degrade when clean speech data is scarce. Modern Greek exemplifies this, lacking the curated corpora behind state-of-the-art synthesis. We propose a data… 19 arXiv — NLP / Computation & Language research 1mo ago NOPE-HYPE: A Structured Simulation Workflow for Robust Speech-to-Text Across Diverse Acoustic Environments arXiv:2609.10058v1 Announce Type: cross Abstract: Robust speech-to-text translation systems should perform reliably across diverse acoustic conditions, yet practical pipelines lack controllable tools for systematic environment exploration. Large speech models remain sensitive to… 32 Page 6 of 10 · 500 articles ← Newer Older →
