News / #voice Tag Voice 500 articles archived under #voice · RSS Sign in to follow Hugging Face Daily Papers research 1mo ago Puppeteer: Object-Grounded Posture-Aware Co-Speech Gesture Generation Abstract Puppeteer is a diffusion-based co-speech gesture model that uses causal latent tokens and object geometry to generate temporally coherent, physically grounded gestures. Generated by thinkingmachines/Inkling-Small Generating co-speech gestures that are temporally… 38 OpenAI official-blog 1mo ago Build more natural voice experiences with GPT‑Live‑1 in the API GPT‑Live‑1 brings natural, full-duplex voice conversations to the API, with stronger instruction following, custom voices, and telephony support. 14 TechCrunch — AI news-outlet 1mo ago Massachusetts hits data centers with new clean power rules Massachusetts has become the third state in as many months to slap new restrictions on data center development. 4 TechCrunch — AI news-outlet 1mo ago Apple Watch’s new AI features are normalizing the idea that technology is always listening Apple says its new watches won’t save raw audio, but features that can transcribe recent speech and summarize ambient conversations raise new questions about consent, privacy, and how people behave when they know they could always be recorded. 30 r/LocalLLaMA community 1mo ago Adding emotion control tags to Qwen3-TTS I fine-tuned Qwen3-TTS with inline transcript control tags rather in lieu of a separate instruction parameter and thought the community here might be interested in the result. https://huggingface.co/SpragAI/qwen3-tts-emotion-tags The basic premise was to use Qwen's CustomVoice… 14 r/LocalLLaMA community 1mo ago Best Open source TTS right now for narration? I run these models on Kaggle notebook, so not all TTS models, such as the ones that use conda env, are compatible (Or I just haven't found a way for them to work on Kaggle). I currently use a fork from Chatterbox called Chatterbox Audiobook. It is like a workstation really… 22 Hugging Face Daily Papers research 1mo ago What Did I Just Say? Self-Listening for Full-Duplex Speech Models Abstract Self-Listening grounds interruption recovery in full-duplex spoken language models by feeding realized speech back as input, improving consistency with actually spoken responses. Generated by thinkingmachines/Inkling-Small Full-duplex spoken language models can listen… 4 Hugging Face Daily Papers research 1mo ago AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing Abstract AuK is an open-source foundational model that unifies speech generation and editing via natural-language instructions and audio context, using a multimodal language model, joint VAE, hybrid rectified-flow Transformer, and efficient distillation for fast inference.… 37 The Information — AI news-outlet 1mo ago ElevenLabs Hires CFO, Eyes 2028 IPO While all eyes are on Anthropic’s forthcoming IPO prospectus, set to drop in the coming weeks, other fast-growing AI startups are laying the groundwork for their own public offerings. The latest is AI voice startup ElevenLabs , which has hired a chief financial officer as it… 6 ElevenLabs official-blog 1mo ago Sonic branding: Building your brand identity through sound Discover how sonic branding helps brands stand out with unique audio signatures. Explore how voice selection is the new frontier of sonic branding. 28 r/LocalLLaMA community 1mo ago Voice conversations between Gemma4 12B and E2B on GPU and Jetson Orin Gemma 4 12B runs on an RTX PRO 4500 Blackwell. Gemma 4 E2B run on a Jetson Orin NX 16GB; similar performance is expected on a Jetson Orin Nano Super 8GB. Both systems use a reSpeaker Flex 4-mic array and a 3W speaker. Inference is handled by Cortexist Little Gemma, a small LLM… 31 ElevenLabs official-blog 1mo ago Allegro gives over 20 million shoppers instant answers on delivery hotlines Allegro deploys ElevenAgents voice agents to give its 20M+ shoppers instant answers on delivery hotlines 24 arXiv — NLP / Computation & Language research 1mo ago GEPARD - Generative, Prosody-aware, Autoregressive text-to-speech model for Realtime Dialogue arXiv:2609.04222v1 Announce Type: cross Abstract: We present GEPARD (Generative, Prosody-aware, Autoregressive text-to-speech model for Realtime Dialogue), a streaming text-to-speech model for real-time spoken dialogue. GEPARD generates speech autoregressively with an LLM… 14 arXiv — NLP / Computation & Language research 1mo ago The Anatomy of an ASR Hallucination arXiv:2609.04404v1 Announce Type: new Abstract: ASR systems sometimes produce fluent text that is unrelated to the speech they receive. We view these hallucinations as one possible consequence of a broader grounding failure, in which the transcript is no longer adequately guided… 29 arXiv — NLP / Computation & Language research 1mo ago Auditing Bias and Safety in Voice AI Customer Care arXiv:2609.04206v1 Announce Type: cross Abstract: Voice AI systems increasingly mediate customer care interactions where caller presentation cues such as accent, affect, fluency, and urgency are available alongside the service request. Existing fairness and safety evaluations… 15 arXiv — NLP / Computation & Language research 1mo ago Automatic Speech Recognition for Multilingual Oral History Research arXiv:2609.04232v1 Announce Type: cross Abstract: This paper offers a unique perspective on how speech technologies are being adopted by community-led heritage language preservation and revitalisation initiatives. As a community-led language maintenance strategy, oral histories… 24 Hugging Face Daily Papers research 1mo ago Motion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialogue Abstract Motion-Omni is an end-to-end framework that jointly generates spoken dialogue and full-body co-speech motion from shared hidden states, using scalable pseudo-labeling and a unified evaluation protocol to achieve real-time, aligned responses. Generated by… 28 Hugging Face Daily Papers research 1mo ago A Common Measure of Communication for Speech Brain-Computer Interfaces Abstract Open-vocabulary mutual information provides a unified metric to compare speech brain-computer interfaces across different vocabularies and conditions, revealing trade-offs between vocabulary coverage and decoding accuracy. Generated by thinkingmachines/Inkling-Small… 18 r/LocalLLaMA community 1mo ago How do you guys handle your personal RAG setup I am getting into developing a RAG setup, for getting information out of existing documents, new document ingestion, web searches, and good visuals. I am planning to use it for, alongside the regular "chat to my data", ingesting personal docs, invoices, creating tables views and… 7 ElevenLabs official-blog 1mo ago Eliane and Alberto: The 1 Million Voices Initiative Expands to Brazil Eliane and Alberto met in São Paulo in 2024. She has a condition which took her voice. He is blind and has never known Eliane’s true voice until now. 32 ElevenLabs official-blog 1mo ago Havells brings multilingual voice control to its connected home ecosystem with ElevenLabs Havells brings multilingual voice control to connected home ecosystem with ElevenLabs 15 arXiv — Machine Learning research 1mo ago The 2026 PNPL Competition: Word Classification and Efficient Cross-Subject Generalisation in LibriBrain100 arXiv:2609.03231v1 Announce Type: new Abstract: The ambition of the 2025 PNPL competition (Landau et al., 2025) was to launch a multi-year curriculum for non-invasive speech decoding. Designed to progress from foundational tasks toward the linguistic complexity required for a… 13 arXiv — NLP / Computation & Language research 1mo ago Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognition arXiv:2609.02901v1 Announce Type: new Abstract: Modern automatic speech recognition (ASR) scenarios require both spoken-form transcripts for faithful transcription and readable written-form transcripts with inverse text normalization (ITN). However, these forms are typically… 24 arXiv — NLP / Computation & Language research 1mo ago Listen to the Latents: Self-Correcting Speech Recognition in Large Audio Language Models Through Hidden-State Interactions arXiv:2609.02940v1 Announce Type: new Abstract: Recent automatic speech recognition (ASR) systems increasingly integrate large language models (LLMs) to leverage their semantic knowledge, either externally through logit fusion or internally through warm initialization. However,… 11 arXiv — NLP / Computation & Language research 1mo ago Building and Evaluating Fixed-Voice Thai TTS from Synthetic Speech arXiv:2609.03502v1 Announce Type: new Abstract: In low-resource settings, deploying TTS typically requires choosing between a large voice-cloning model with costly inference or a compact fixed-voice system that requires a speaker-specific corpus. We study a third route: using a… 33 arXiv — NLP / Computation & Language research 1mo ago Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis arXiv:2609.03992v1 Announce Type: new Abstract: We present Alignment-Free Text-Audiobox (Text-AB), a unified framework for high-quality voice dubbing and full-duplex dialogue synthesis. Building on a Diffusion Transformer trained with a flow-matching objective, Text-AB departs… 7 arXiv — NLP / Computation & Language research 1mo ago SISER: Speaker-Invariant Speech Emotion Recognition with Entropy-Based Adversarial Training arXiv:2609.02941v1 Announce Type: cross Abstract: Speech emotion recognition (SER) faces two fundamental challenges: scarcity of labeled data and inter-speaker variability, both of which hinder generalization of emotion recognition systems. While prior adversarial approaches… 32 arXiv — NLP / Computation & Language research 1mo ago VoxReason: Listener-Free Evaluation of Source-Grounded Speech Planning Before Synthesis arXiv:2609.03203v1 Announce Type: cross Abstract: Expressive speech systems make a decision before any waveform is rendered: how an utterance is delivered. In dialogue agents, narration, and role-conditioned TTS, that hidden planning step sets affect, pitch, energy, rate, pause,… 16 r/LocalLLaMA community 1mo ago I released sanoTTS: smallest complete TTS stack in 294k params (337 KB) that runs on $3 microcontroller and a 1.46m one that beats models 3x and 10x it's size I have been trying to squeeze TTS stack down far enough to run in a $3 chip which has 512kb of SRAM without NPU. While trying to get to that milestone i built sanoTTS which has - 11 voices, 6 languages - params size ranging from 294k - 2.2m. For comparison we are 1000x smaller… 35 The Information — AI news-outlet 1mo ago Anthropic Splits From Google, OpenAI Over State AI Safety Bill Anthropic is at odds with other big tech firms over a Massachusetts Senate proposal requiring big AI developers to hire independent evaluators to assess catastrophic risks posed by their models every four months. The Massachusetts proposal could set a new standard for AI… 19 Hugging Face Daily Papers research 1mo ago VibeVoice-ASR-Streaming Technical Report Abstract A streaming, LLM-based end-to-end model unifies speaker-attributed speech recognition and diarization for low-latency real-time applications. Generated by thinkingmachines/Inkling-Small Traditional speaker-attributed ASR systems treated ASR and speaker diarization as… 34 arXiv — Machine Learning research 1mo ago A Common Measure of Communication for Speech Brain-Computer Interfaces arXiv:2609.02887v1 Announce Type: new Abstract: Speech brain-computer interfaces (speech BCIs) translate neural activity into language, offering a path towards restoring speech for people with paralysis and, more broadly, enabling new forms of natural human-computer interaction.… 16 arXiv — Machine Learning research 1mo ago Hearing the Whispers: Black-Box Membership Inference Attacks on Finetuned TTS Models arXiv:2609.01723v1 Announce Type: cross Abstract: Text-to-Speech (TTS) foundation models are increasingly fine-tuned on private datasets to synthesize highly personalized voices, introducing severe privacy risks by exposing both biometric identities and sensitive speech content.… 36 arXiv — NLP / Computation & Language research 1mo ago SpeakPay: Domain-Adaptive LoRA Fine-Tuning of Whisper for Low-Resource Nepali Financial Speech Recognition arXiv:2609.01737v1 Announce Type: new Abstract: Mobile payment applications in Nepal are graphically mediated and largely inaccessible to visually impaired users. This paper presents SpeakPay, a voice-first digital wallet, and documents the central technical contribution: a… 26 arXiv — NLP / Computation & Language research 1mo ago AVERT: Audio-Verified Adjudication for Spoken Dialogue State Tracking arXiv:2609.01828v1 Announce Type: new Abstract: Spoken dialogue state tracking recovers slot-value pairs from speech, where ASR errors concentrate in entity values and persist across turns, making it both a generation and an editing problem. A strong per-turn text editor… 29 arXiv — NLP / Computation & Language research 1mo ago Predictors of Loneliness in Older Adults Using Multimodal Analysis of Speech and Language arXiv:2609.02606v1 Announce Type: new Abstract: Loneliness is a critical public health issue among older adults, linked to higher risks of depression, cognitive decline, and mortality. Scalable, objective methods for its detection remain limited, particularly in natural… 23 arXiv — NLP / Computation & Language research 1mo ago Choosing a PEFT Variant for Per-Patient Dysarthric ASR: A Single-Speaker Case Study on Two ASR Bases arXiv:2609.02735v1 Announce Type: new Abstract: Per-patient adapters are the preferred production architecture for dysarthric automatic speech recognition (ASR), yet parameter-efficient fine-tuning (PEFT) variants have not been compared in the speaker-dependent, per-patient… 7 arXiv — NLP / Computation & Language research 1mo ago Scalable Direction-Following TTS via Voice Impression-Guided Pseudo Triplet Construction arXiv:2609.02623v1 Announce Type: cross Abstract: Voice actors often re-read the same script while modifying their delivery in response to performance directions. We study this setting as direction-following TTS, where a system generates a new utterance that reflects a given… 6 r/LocalLLaMA community 1mo ago Microsoft VibeVoice-ASR-Streaming Released   submitted by   /u/Acceptable-Cycle4645 [link]   [comments] 23 r/LocalLLaMA community 1mo ago VoxGen, an AMD-optimized TTS inference engine for VoxCPM 2 models Hi, everyone, I’ve just released VoxGen, a lightweight native inference engine for VoxCPM2, written in Rust and using Vulkan compute instead of Python/PyTorch/CUDA. Why VoxGen? The main reason I started the project was because I needed a decent local text-to-speech solution. I… 10 llama.cpp releases dev-tools 1mo ago b10760 mtmd: Fix Qwen3-tts-0.6b ( #28231 ) mtmd: load the qwen3-tts code predictor proj_in as optional The talker and the code predictor share the hidden size on the 0.6B checkpoints, so the reference builds no small_to_mtp_projection and the conversion emits no tensor for it. The… 27 arXiv — NLP / Computation & Language research 1mo ago Topic Matching in the Wild: Benchmark and Lessons from Real-World ASR Transcripts arXiv:2609.00330v1 Announce Type: new Abstract: In contact centers, real-time agent-assist tools determine, for each of many predefined topics, whether a live customer utterance is relevant and display a coaching card to the agent when it is. The input is noisy and challenging:… 33 arXiv — NLP / Computation & Language research 1mo ago Staged Linguistic Seeding: Grounded Query Expansion for Verified-Unit QA in AI Contact Centers arXiv:2609.00844v1 Announce Type: new Abstract: Customer-service QA in an AI contact center (AICC) runs under deployment constraints that benchmark QA misses: tight voice-hotline latency and a high cost for unsupported or wrong automatic answers. We deploy a system that answers… 27 arXiv — NLP / Computation & Language research 1mo ago Phrase-Localized Language-Contrastive Guidance: Training-Free Localized Accent Control for Code-Switching Text-to-Speech arXiv:2609.01016v1 Announce Type: new Abstract: Current speech synthesis struggles with code-switching, which mixes a foreign language phrase into a primary language utterance, causing the phrase to be spoken with the primary language's accent rather than its native one. We… 29 arXiv — NLP / Computation & Language research 1mo ago Ready to Speak: Aligning LLMs for TTS-Friendly Text Generation arXiv:2609.01246v1 Announce Type: new Abstract: Current Large Language Models (LLMs) are primarily optimized for written text, often producing outputs that are grammatically correct and helpful yet poorly suited for spoken delivery via Text-to-Speech (TTS). In this work, we… 20 r/LocalLLaMA community 1mo ago Really stunned by the Singularity comment section These are screenshots from the r/Singularity comment section. I'm speechless. This doesn't even have downvotes. How can someone cheer for a monopoly run by a few elites?   submitted by   /u/Howard_banister [link]   [comments] 13 The Information — AI news-outlet 1mo ago Meta Unveils New Audio AI Model Meta Platforms on Tuesday unveiled a new audio transcription model, Muse Voice Transcribe, that CEO Mark Zuckerberg said can transcribe speech to text and segment audio based on who is speaking. According to Zuckerberg’s announcement in a Threads post , the model was trained on… 34 r/MachineLearning community 1mo ago We released TontaubeV1, a character-level TTS model for long-form generation [P] Hey everyone, My brother and I just released TontaubeV1, a 2.9B-parameter open-weight TTS model focused on expressive speech, long-form generation/narration, and low-latency local inference. It is primarily aimed at English and German and supports zero-shot voice cloning from up… 14 r/LocalLLaMA community 1mo ago Vellium v1.1.0 — Live voice, local STT/TTS and easier llama.cpp setup Vellium is an open-source, local-first desktop app for AI chat, character roleplay and long-form writing. Recent updates have focused mostly on making local voice and model setups easier to use. Live mode now supports microphone input, local or Whisper-compatible speech… 15 arXiv — Machine Learning research 1mo ago V2TATC: A Joint Voice-Trajectory Embedding Framework and Dataset for Air Traffic Controller Situational Awareness arXiv:2608.28981v1 Announce Type: new Abstract: As air traffic volumes in the National Airspace System continue to expand, in particular in the low altitude airspaces, the need for scalable decision support tools used by air traffic controllers will also require more… 33 Page 7 of 10 · 500 articles ← Newer Older →
