News / #voice Tag Voice 500 articles archived under #voice · RSS Sign in to follow r/LocalLLaMA community 1mo ago Granite Speech 5.0 Turbo CTC: Extremely Fast and Accurate Transcription   submitted by   /u/coder543 [link]   [comments] 4 Hugging Face Daily Papers research 1mo ago EchoWM: Open and Enterable Omnimodal World Models Abstract EchoWM is an omnimodal world model that generates synchronized high-resolution video, sound, music, and speech while following continuous 6-DoF navigation trajectories across first- and third-person views. Generated by thinkingmachines/Inkling-Small We present EchoWM,… 17 Hugging Face Daily Papers research 1mo ago Better Retrieval, Worse Robustness:How Multi-hop RAG Amplifies Upstream ASR Errors Abstract Retrieval-augmented generation extensions amplify automatic speech recognition errors in spoken multi-hop question answering, primarily through corrupted query entities. Generated by thinkingmachines/Inkling-Small Speech-based applications pass spoken queries through… 12 arXiv — NLP / Computation & Language research 1mo ago Bulbul: A Dataset for Dialectal Arabic Speech Recognition arXiv:2608.21950v1 Announce Type: new Abstract: Arabic automatic speech recognition (ASR) faces unique challenges due to diglossia, extensive regional dialect variation, and limited speech resources. Existing speech datasets often focus on single dialects or large-scale… 5 arXiv — NLP / Computation & Language research 1mo ago Whitewashing Hate, Smearing Harmless Content: Annotator-Style Rebuttal Attacks on LLM-Based Moderation arXiv:2608.22230v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for hate speech moderation, often within human--AI workflows in which reviewers provide feedback before a final decision. Such feedback introduces two manipulation directions:… 35 arXiv — NLP / Computation & Language research 1mo ago WnW: Waxing-and-Waning KV Cache for Long-Form Speech LLMs arXiv:2608.22704v1 Announce Type: new Abstract: Long-form audio inputs make the KV cache the dominant memory cost of speech LLMs. Prefill-only KV compression methods permanently discard audio KV positions once evicted, with no pathway to recover them during decoding. We show… 11 arXiv — NLP / Computation & Language research 1mo ago Better Retrieval, Worse Robustness:How Multi-hop RAG Amplifies Upstream ASR Errors arXiv:2608.22872v1 Announce Type: new Abstract: Speech-based applications pass spoken queries through automatic speech recognition (ASR) before any retrieval module, so ASR errors enter the pipeline as a fixed upstream constraint. We empirically test whether two extensions to… 33 arXiv — NLP / Computation & Language research 1mo ago Do Spoken Language Models Hear Speech as They Read Text? Bridging Structural Gaps Between Speech and Text arXiv:2608.22908v1 Announce Type: new Abstract: Spoken Language Models (SLMs) generate textual responses directly from speech, offering an alternative to cascaded systems. Despite recent advances, existing SLMs still exhibit weaker instruction-following behavior and limited… 10 r/LocalLLaMA community 1mo ago iPhone Local TTS EPUB Reading - Audiobookify I've been working on this project (been a developer for a few years) for a few months now, and it has been in active testing for ~2 months. Its an EPUB reader that also offers local offline TTS, so its not just TTS focused, its meant to be a good regular reading app as well. I'd… 38 r/LocalLLaMA community 1mo ago Best AI Voice Cloning in 2026: How to Clone Your Voice With AI   submitted by   /u/NextgenAITrading [link]   [comments] 14 arXiv — Machine Learning research 1mo ago Training DeepFilterNet with Accurate Room Acoustic Simulations Improves Single-Channel Speech Enhancement arXiv:2608.20971v1 Announce Type: cross Abstract: We investigate how the realism of synthetic room impulse response (RIR) datasets affects the training of DeepFilterNet3 for single-channel speech enhancement. We compare a DNS4 image-source-method (ISM) RIR dataset with a… 6 arXiv — NLP / Computation & Language research 1mo ago Building and Evaluating a Synthetic Bengali Speech Resource for Telecom Customer Care arXiv:2608.20346v1 Announce Type: new Abstract: Speech systems used in customer-facing applications often require domain-specific language coverage. We present a synthetic Bengali speech dataset for telecom customer-care scenarios. The dataset contains 10,000 audio-text pairs,… 8 arXiv — NLP / Computation & Language research 1mo ago Trilingual Topic Modeling of Sri Lankan Parliamentary Debates arXiv:2608.20365v1 Announce Type: new Abstract: Sri Lankan parliamentary debates (Hansards) constitute a trilingual corpus of speeches in Sinhala, Tamil, and English, including code-mixed content, yet remain inaccessible to standard NLP pipelines due to layout-complex PDFs,… 27 arXiv — NLP / Computation & Language research 1mo ago Poly-InstructTTS: Learning In-the-Wild Expressive Speech Synthesis from Open-Ended Instructions arXiv:2608.20387v1 Announce Type: new Abstract: While recent text-to-speech (TTS) models achieve high naturalness, controlling fine-grained expression via natural-language instructions remains challenging. We introduce Poly- InstructTTS, which learns expressive speech from… 9 arXiv — NLP / Computation & Language research 1mo ago Self-Supervised Speech Representations Track Spoken Language Convergence to Adult Models in Infants and Children Who Are Deaf/Hard-of-Hearing arXiv:2608.20396v1 Announce Type: new Abstract: Language development is characterized by a gradual convergence of children's speech toward adult patterns. Measuring this process has traditionally required detailed transcription and language-specific expertise, limiting… 4 arXiv — NLP / Computation & Language research 1mo ago A Factorial Ablation of a Speech-to-SFT Pipeline: Differential Effects on Data Quality and Downstream Transfer arXiv:2608.20394v1 Announce Type: cross Abstract: Industry pipelines that turn speech into supervised fine-tuning (SFT) data via multi-stage refinement are increasingly adopted but, to our knowledge, have not been publicly ablated stage-by-stage, leaving each stage's marginal… 8 arXiv — NLP / Computation & Language research 1mo ago TurboBias 2.0: Streaming Context-Biasing for Production-Efficient ASR Systems arXiv:2608.21343v1 Announce Type: cross Abstract: Contextualization is essential for production automatic speech recognition (ASR) systems, where user-provided phrases must be recognized accurately under strict latency constraints. Although many context-biasing methods improve… 13 r/LocalLLaMA community 1mo ago Has anyone tried agent-lightning?   submitted by   /u/MrMrsPotts [link]   [comments] 14 r/LocalLLaMA community 1mo ago Create tts voice from actual animal sound recording In short, I want to create voices for my real chickens that I'm creating generated videos of. Ultimately I would like to create voices to be used in a tts application that are based on their real "voice patterns", as though the voice was being made with their own vocal chords. I… 26 r/LocalLLaMA community 1mo ago How to remove trendy speech from llms? For example: Instead of saying: "I created this new ID" It says: "I minted this new ID" Instead of: "This alternative path is available" It says: "this escape hatch is available" This speech is so nonsensical and annoying. Just. Speek. Literally ... OR NORMALLY. Where did LLMs… 19 r/LocalLLaMA community 1mo ago Ultrafast Qwen3-TTS at 34 ms Time-to-First-Audio, Handling 10 Requests Per Second [OSS] Hey locallama! We recently open sourced a Qwen3-TTS 1.7B implementation that achieves 10 requests per second (RPS) and sub-50 ms p95 time-to-first-audio (TTFA) while maintaining real-time playback on 1 x H100. This extends to 20 RPS at sub-100 ms p95 TTFA. By adjusting settings,… 31 Hugging Face Daily Papers research 1mo ago Towards Quantifying Benchmark Optimization in ASR Models Abstract High-performing speech recognition models reproduce benchmark transcripts despite contradictory audio, revealing benchmark-optimized behaviors that inflate scores without improving real-world transcription. Generated by thinkingmachines/Inkling-Small Public benchmarks… 13 arXiv — Machine Learning research 1mo ago Decoding silent reading from non-invasive EEG arXiv:2608.20186v1 Announce Type: new Abstract: Non-invasive decoding of inner speech faces a fundamental data problem: a corpus pairing brain activity with a person's spontaneous inner monologue cannot be collected, and the available proxy paradigms (cued repetitive and… 15 arXiv — NLP / Computation & Language research 1mo ago Represented but Ignored: A Causal Account of Prosodic Underuse in Audio-Language Models arXiv:2608.19211v1 Announce Type: new Abstract: Human speech is richly expressive, with prosody carrying linguistic and emotional information beyond the lexical content. A capable large audio-language model (audio-LLM) should therefore support expressive speech understanding,… 4 arXiv — NLP / Computation & Language research 1mo ago A Speech Corpus for Mizo Automatic Speech Recognition: Whisper and SraVaani 1.0 Fine-Tuning with Morphology-Aware Evaluation arXiv:2608.19361v1 Announce Type: new Abstract: This study reports the development of an Automatic Speech Recognition (ASR) system in Mizo, a low-resource language. The development included collecting 17.62 hours of speech data, curating it, and fine-tuning the Mizo ASR system… 4 r/LocalLLaMA community 1mo ago Make Jensen Huang Sound Like Anyone. New Streaming Voice Conversion Model MeanVC2 Released! Finally see a new voice conversion model. MeanVC2 supports cross-gender and cross-language voice conversion. 3x realtime on CPU with audio.cpp. Disclaimer: The converted voice quality of MeanVC2 is decent; the noise comes from my rough demo engineering, not the model itself.… 38 Hugging Face official-blog 1mo ago Measuring benchmark optimization in speech recognition Back to Articles a]:hidden"> Measuring benchmark optimization in speech recognition Published August 21, 2026 Update on GitHub Upvote 1 Theo Lebryk tlebryk02 HumeAI Eric Bezzam bezzam Alice aliceebaird HumeAI David Ayllon dayllon HumeAI Jakub Piotr Cłapa jpc HumeAI Jens Madsen… 22 arXiv — NLP / Computation & Language research 1mo ago StocksTalk: A Voice-Enabled Conversational Agent for Structured Query Generation over Web Data arXiv:2608.18105v1 Announce Type: new Abstract: StocksTalk is a voice-enabled conversational system for transforming spoken financial screening requests into executable and validated structured queries over real-world market data. The system combines streaming speech… 9 arXiv — NLP / Computation & Language research 1mo ago X2Streaming-TTS: Causal Token-Level Text-to-Speech from Streaming Text with Speech-State Inheritance arXiv:2608.18661v1 Announce Type: new Abstract: Streaming text-to-speech is essential for low-latency spoken dialogue systems, yet many systems wait for sentence-level text and are therefore only pseudo-streaming. True token-level synthesis must generate speech from uncertain… 30 arXiv — NLP / Computation & Language research 1mo ago Understanding Multilingual Medical ASR Adaptation Through Layer-Wise Analysis arXiv:2608.18825v1 Announce Type: new Abstract: Medical automatic speech recognition (MedASR) requires adaptation to specialised terminology, limited annotated clinical data, and multilingual use cases. Although large-scale pretrained ASR models such as Whisper achieve strong… 19 arXiv — NLP / Computation & Language research 1mo ago Introducing the Privacy-HSD Trade-off: Hate Speech Detection, but not at the Cost of Privacy arXiv:2608.19006v1 Announce Type: new Abstract: Hate speech is a real and timely threat that affects a large portion of online users, especially youth and minority groups. While building reliable and robust automatic hate speech detection (HSD) systems is paramount, we argue… 24 arXiv — NLP / Computation & Language research 1mo ago Safety Alignment Illusion: The Cross-Lingual Safety Gap in LLMs arXiv:2608.18131v1 Announce Type: cross Abstract: Current safety alignment training for Large Language Models (LLMs) are heavily English-centric. When such safety filters fail for non-English languages, the consequences are immediate and user-facing: voice assistants and spoken… 32 arXiv — NLP / Computation & Language research 1mo ago Efficient Adaptation of LLMs for Hate Speech Detection in Low-Resource Languages: A Comparative Study on Roman Urdu arXiv:2608.18142v1 Announce Type: cross Abstract: It is challenging to detect hate speech in Low Resource Languages (LRLs) because of the absence of annotated data, the informality of its language structure, and the lack of standardized grammar. A good example of such a… 19 arXiv — NLP / Computation & Language research 1mo ago Emotion Across Speech and Faces: Shared Affective Mechanisms in Multimodal Foundation Models arXiv:2608.17102v1 Announce Type: new Abstract: Modern multimodal foundation models (MFMs) have made rapid progress on tasks requiring integrated perception across speech, vision, and language, including emotion recognition. However, it remains unclear whether they recognize… 15 arXiv — NLP / Computation & Language research 1mo ago SpeechSense: A Paralinguistic-Focused Dataset for Fine-Grained Speech Sentiment Analysis arXiv:2608.17931v1 Announce Type: new Abstract: Recent advances in AI have revolutionized speech processing, yet effective speech understanding requires discerning not just what is said, but how it is said. Speech Sentiment Analysis plays a critical role in decoding these… 36 arXiv — NLP / Computation & Language research 1mo ago Language Family Matters: Evaluating LLM-Based ASR Across Linguistic Boundaries arXiv:2601.18899v3 Announce Type: replace Abstract: Large Language Model (LLM)-powered Automatic Speech Recognition (ASR) systems achieve strong performance with limited resources by linking a frozen speech encoder to a pretrained LLM via a lightweight connector. Prior work… 15 arXiv — NLP / Computation & Language research 1mo ago Speak in Context: Multilingual ASR with Speech Context Alignment via Contrastive Learning arXiv:2603.06505v2 Announce Type: replace Abstract: Automatic speech recognition (ASR) has benefited from advances in pretrained speech and language models, yet most systems remain constrained to monolingual settings and short, isolated utterances. While recent efforts in… 17 Vercel — AI dev-tools 1mo ago Fish Audio models now available on Vercel AI Gateway for free Fish Audio 's audio models are now available on AI Gateway. To celebrate the launch, every Fish Audio model is free on AI Gateway for the next 30 days, through September 18. Capability Regular Through September 18 Text-to-speech $15.00 per million characters Free Speech-to-text… 22 Hugging Face Daily Papers research 1mo ago AnyTalk: Speech Animation for Arbitrary Characters Leveraging a Video Generation Model Abstract AnyTalk generates 3D speech animations for arbitrary characters without animation data by adapting video diffusion models via character-specific fine-tuning and optimizing blendshape parameters from synthesized talking-head videos, with a distilled real-time variant.… 9 arXiv — NLP / Computation & Language research 1mo ago Multi-Modal Generative Fuzzy System: Fuzzy Inference Guided Large Model Interactive Question Answering Framework arXiv:2608.14584v1 Announce Type: new Abstract: In Multimodal Question Answering (MQA), models are required to jointly encode and integrate heterogeneous information from multiple modalities, including text, images, and speech, to perform complex semantic reasoning and decision… 29 arXiv — NLP / Computation & Language research 1mo ago Beyond the pale: Assessing prevalence and contents of extremist speech in LLM training data arXiv:2608.14813v1 Announce Type: new Abstract: Despite a strong interest on the part of the research community in the topic of trustworthy and safe AI, the composition of the text corpora that large language models (LLMs) encounter in pre- and post-training has not yet drawn… 26 arXiv — NLP / Computation & Language research 1mo ago Semantic Space of Parts of Speech arXiv:2608.15443v1 Announce Type: new Abstract: Parts of speech categorization is understood in the European linguistic tradition as crisp categorization, which is also reflected in corpus linguistics, where each disambiguated token is assigned exactly one POS. However, the… 11 arXiv — NLP / Computation & Language research 1mo ago The Null Token Knows: Reducing Message-Free Hallucination in ASR and NMT arXiv:2608.15940v1 Announce Type: new Abstract: Modern encoder-decoder systems can produce fluent text even when their input contains no recoverable message. We study this failure in ASR and NMT through the models' reserved null tokens, asking whether the score for ending… 22 arXiv — NLP / Computation & Language research 1mo ago DuplexGen: Decoupling Content, Timing, and Acoustics for Synthetic Dialogue Speech arXiv:2608.16053v1 Announce Type: new Abstract: Synthetic conversational speech has become an important resource for developing and evaluating conversational speech systems. However, existing dialogue synthesis pipelines typically generate dialogue content first and then insert… 28 arXiv — NLP / Computation & Language research 1mo ago Unadapted Multilingual ASR on a Garrusi Kurdish Evaluation Set: A Common-Reference Staged Normalization Analysis arXiv:2608.16379v1 Announce Type: new Abstract: Evaluating speech recognition for a Kurdish variety written in a Latin field orthography, using a model that outputs Arabic script, creates a measurement problem before a modelling one: direct scoring treats writing-system… 38 arXiv — Machine Learning research 1mo ago VoiceDesigner: Text-to-Voice Generation and Editing via Unified Diffusion Modeling and Data Augmentation arXiv:2608.13613v1 Announce Type: cross Abstract: Recent breakthroughs in generative models have made text-to-voice generation (TTV) possible, enabling the synthesis of speech directly from textual voice descriptions. However, existing systems face two key challenges. First,… 21 arXiv — NLP / Computation & Language research 1mo ago Measuring Fairness in Large Audio Language Models via Semantic-Aware Bias Estimation arXiv:2608.13624v1 Announce Type: new Abstract: Large Audio Language Models (LALMs) have seen increasing use for audio understanding tasks such as speech recognition and audio question answering, raising concerns about fairness across demographic subgroups. Fairness evaluation… 7 arXiv — NLP / Computation & Language research 1mo ago StreamHear: Domain-Adapted Pseudo-Labeling for Semi-Supervised Streaming Speech Recognition arXiv:2608.13717v1 Announce Type: new Abstract: Streaming automatic speech recognition (ASR) underperforms on domain-shifted target audio, where labeled in-domain data is costly to prepare while unlabeled audio is abundant. We present StreamHear, a semi-supervised pipeline that… 19 arXiv — NLP / Computation & Language research 1mo ago Leading-Silence Augmentation and Multi-Stage Synthetic Supervision for the Second MLC-SLM Challenge arXiv:2608.14150v1 Announce Type: new Abstract: The second Multilingual Conversational Speech Language Model (MLC-SLM) Challenge evaluates two tasks over complete, unsegmented multilingual conversations: speaker diarization and recognition (Task 1) and conversational speech… 16 arXiv — NLP / Computation & Language research 1mo ago VoiceChat-TTS: A Low-Latency Continuous Speech Synthesis Model for Interactive Agents arXiv:2608.13831v1 Announce Type: cross Abstract: Spoken dialogue is a natural form of human--computer interaction, yet most speech language models remain limited to turn-based operation and lack real-time adaptability, such as user barge-in. Recent duplex speech-to-speech and… 30 Page 9 of 10 · 500 articles ← Newer Older →
