News / #voice Tag Voice 500 articles archived under #voice · RSS Sign in to follow r/LocalLLaMA community 7d ago d1-3B and d1-omni from LiquidAI https://preview.redd.it/owhrvbbiu2uh1.png?width=4096&format=png&auto=webp&s=55d816753e7adee0e1391c9f581052b4bde44da7 d1-omni-600M d1-omni-600M is a 600M parameter decision model built on LFM2.5-Encoder-350M . You give it a state (text or JSON, with images or a voice clip) and a… 28 Hugging Face official-blog 7d ago Introducing Falcon ASR Back to Articles a]:hidden"> Introducing Falcon ASR Team Article Published October 7, 2026 Upvote 1 Abdul Muneer abdulmuneertii tiiuae Rishabh Saraf rishabh-saraf tiiuae Ramesh Gundluru gundlururamesh tiiuae Shamsa Hamad shamsaH tiiuae Lepauloux Ludovick tiiuae Hakim Hacid… 38 arXiv — NLP / Computation & Language research 7d ago EMODE: Dynamic Para-Semantic Experts for Emotion-Aware Speech Language Modeling arXiv:2610.06956v1 Announce Type: new Abstract: Large speech language models have demonstrated strong capabilities in unified cross-modal understanding and generation, yet paralinguistic cues, especially emotion, remain difficult to preserve. Existing systems typically rely on… 14 arXiv — NLP / Computation & Language research 7d ago AccentCL: Robust Accent Classification with Incremental Expansion arXiv:2610.07426v1 Announce Type: new Abstract: Accent classifiers are typically trained with a fixed label inventory and cannot accommodate new accent categories as new data becomes available. Moreover, accented speech corpora often exhibit substantial class imbalance and/or… 29 arXiv — NLP / Computation & Language research 7d ago Quality-Aware Self-Correcting Speech Translation on an Edge Device arXiv:2610.07545v1 Announce Type: new Abstract: We present a fully offline speech-to-speech translation pipeline that runs on a Jetson Nano (4 GB) and corrects its own weak translations without retraining. A Whisper-tiny ASR feeds an Opus-MT translator; multilingual BERT cosine… 30 arXiv — NLP / Computation & Language research 7d ago DirectSpeech2LLM: A Simple End-to-End Framework to Mitigate Prompt Overfitting in Speech-LLMs arXiv:2610.08085v1 Announce Type: new Abstract: Speech-LLMs often exhibit prompt overfitting, where models solely trained on automatic speech recognition (ASR) instruction fail to generalize to new instructions such as speech translation and continue to behave primarily as ASR… 33 arXiv — NLP / Computation & Language research 7d ago InterCorrect: Intersection-Aware Correction of Demographic Model Merging for Fair ASR arXiv:2610.08604v1 Announce Type: new Abstract: Automatic Speech Recognition (ASR) systems often show uneven performance across demographic groups, and errors can be especially difficult to address for speakers belonging to multiple demographic groups. This work studies… 5 arXiv — NLP / Computation & Language research 7d ago Pronunciation Editing for Finnish Speech using Phonetic Posteriorgrams arXiv:2507.02115v3 Announce Type: cross Abstract: Synthesizing second-language (L2) speech is potentially highly valued for L2 language learning experience and feedback. However, due to the lack of L2 speech synthesis datasets, it is difficult to synthesize L2 speech for… 14 arXiv — NLP / Computation & Language research 7d ago Nord-Parl-TTS: Finnish and Swedish TTS Dataset from Parliament Speech arXiv:2509.17988v2 Announce Type: cross Abstract: Text-to-speech (TTS) development is limited by scarcity of high-quality, publicly available speech data for most languages outside a few high-resource languages. We present Nord-Parl-TTS, an open TTS dataset for Finnish and… 15 arXiv — NLP / Computation & Language research 7d ago GIVE-KWS: Gated Injection of Visual Evidence for Noise-Robust Query-by-Example Keyword Spotting arXiv:2610.07046v1 Announce Type: cross Abstract: Visual speech promises noise-robust keyword spotting, yet a visual stream is not necessarily used. On a tri-modal query-by-example keyword spotting (QbyE-KWS) benchmark, we find that a system with a task-trained visual encoder… 23 arXiv — NLP / Computation & Language research 7d ago SEAL: Mixture-Closed Additive Reconstruction and Refinement-Aware Expert Routing for Efficient Speech Separation arXiv:2610.07047v1 Announce Type: cross Abstract: Compact time-frequency separators that mask the mixture and refine through a shared cell face two limits. First, a bounded multiplicative mask only scales a mixture bin, so where overlapping components cancel, the estimate stays… 35 r/LocalLLaMA community 9d ago Whistle: speech to text in a 16.9MB file Hey all, we designed Cactus Whistle, an ASR model for ultra-small devices. It's not perfect, but mostly beats Whisper base with 9x less file size and 6x speed. Whistle supports English, German, French, Spanish, Italian, Dutch and Polish. Remember, the goal at Cactus Compute… 20 r/LocalLLaMA community 9d ago Speakrail - a low-latency fully-local voice assistant that runs on a single RTX 4090 tl;dr: I created a fully-local open-source full-duplex voice agent that rivals GPT-Live on some benchmarks. It uses Voxtral Realtime with a turn-taking head, a microturn-finetuned Gemma 4 12B and Breeze TTS 2 under the hood. Go try it out: https://github.com/speakrail/speakrail… 21 r/LocalLLaMA community 9d ago I built an open-source real-time Japanese anime subtitle & translation engine powered by Whisper-Large-v3 + Groq / DeepSeek Hey r/LocalLLaMA , Like many anime fans, I've always been frustrated by traditional MT engines (like Google Translate or base DeepL) when dealing with raw Japanese anime: - They completely butcher Japanese honorifics, sentence-ending particles ( -tteba , -zo , -desu wa ), and… 25 r/LocalLLaMA community 9d ago ItoTTS: two natural English voices in 4.89 MB for a $5 ESP32-S3 Hi everyone! I'm part of the Lokutor team. Last week we presented Oído here, and the response was amazing. We've received dozens of videos and messages from you guys saying you love it. Thank you! Now we're back with the next part of our plan: ItoTTS, a natural-sounding,… 26 arXiv — NLP / Computation & Language research 9d ago Learning When to Commit from Partial Speech for End-to-End Simultaneous Speech Translation arXiv:2610.02612v1 Announce Type: new Abstract: Simultaneous speech translation must emit useful target text before the source is complete while preserving every committed token. We adapt a full-utterance speech language model using prefix supervision derived from its own… 15 arXiv — NLP / Computation & Language research 9d ago An automated pipeline for standardised speech-unit annotation in spontaneous dialogue arXiv:2610.03078v1 Announce Type: new Abstract: Quantifying conversational dynamics requires reliable identification of interactional units and their temporal boundaries, but speech activity alone does not distinguish conversational turns from listener feedback or within-turn… 36 arXiv — NLP / Computation & Language research 9d ago To Jev or Not? Evaluating the Accuracy and Efficiency of Structured Decision Models for Hate-Speech Moderation arXiv:2610.03324v1 Announce Type: new Abstract: The scale of online content makes hate-speech moderation challenging, while Large Language Models (LLMs) enable harmful material to be produced and adapted more easily. Moderation therefore requires efficient classifiers that can… 37 arXiv — NLP / Computation & Language research 9d ago Personalized Automatic Speech Recognition for a Dysarthric and Tracheostomic Speaker using Artificial Conversations arXiv:2610.03017v1 Announce Type: cross Abstract: This work presents an automatic speech recognition (ASR) system personalized for a Czech speaker with a permanent tracheal stoma and severe dysarthria rendering their speech unintelligible to untrained listeners. We release a… 29 r/LocalLLaMA community 10d ago Local text to speech with Breeze is truly incredible Been playing around with local TTS with Breeze combined with STT, and the results are amazing. Using Opus 5.5, I can hear the first sound after 500ms if there is no thinking involved, and with thinking on low mode, can be 1-1.5s. I'm using a BLE remote (the kind that are used… 7 r/LocalLLaMA community 11d ago Dual Radeon MI50 benchmarks Still don't have a good cooling solution, but here are few benchmarks. I lowered the power limit (TDP) to 145 watts each. I changed the firmware on one MI50 to activate the miniDP port. Did have to use xrandr to create a new mode so I could get 1920x1080 output. Each GPU has… 25 r/LocalLLaMA community 11d ago Sopro V2 Turbo 2610: cleaner cloned voices, same 120M model, same CPU speed Follow-up to last month's post. One of the main issues people ran into was roughness or break-up on some cloned voices. 2610 is an interim update focused mostly on improving that. Reduced roughness and break-up on some of the voices that struggled before Same 120M model, same… 9 arXiv — Machine Learning research 11d ago NEUROTOKEN: Joint Source and Directional AAD with Envelope Decoding via Conditional Flow Matching arXiv:2610.00397v1 Announce Type: new Abstract: Identifying which speaker a listener is attending to in a noisy room -- the cocktail-party problem -- is the missing ingredient for next-generation hearing aids and brain-computer interfaces: it tells the device whose voice to… 29 r/LocalLLaMA community 12d ago Qwen3.8-27B-Humanlike-Chat 2.0: texts like a human, now with tool calls and better instruction following Last month I posted a Qwen3.8-27B LoRA that makes it talk like a person instead of an assistant. It got a lot more attention than I expected: 700+ upvotes, 248 comments and 44k downloads since. I read every comment. People really don't like assistant speak, so its tone of voice… 22 OpenAI Python SDK releases dev-tools 12d ago v3.24.0 3.24.0 (2026-10-02) Features api: add custom voice creation and agent session events ( #4013 ) ( e5de2e5 ) Bug Fixes api: prioritize Python request routing fields ( #4014 ) ( ffcc4c4 ) api: prioritize routing fields in parse helpers ( #4016 ) ( ba53a10 ) 6 ElevenLabs official-blog 12d ago How to add pauses in AI voiceover with Eleven v4 Learn three ways to control pauses in AI voiceover with Eleven v4: the [pause] and [long pause] Audio Tags, and punctuation. Includes audio examples. 5 ElevenLabs official-blog 12d ago ElevenLabs powers AI voice agents for patient access at Banner Health Banner Health partners with ElevenLabs on conversational agents that answer patient calls around the clock and book directly in Banner Health's EHR. 26 The Information — AI news-outlet 12d ago Microsoft Debuts Voice AI to Compete with ElevenLabs Microsoft on Thursday launched speech-generating AI that the company says is both cheaper and more accurate than competing models from the likes of ElevenLabs, SpaceXAI and Google. Microsoft aims to produce voice models to power features such as transcribing conference calls in… 11 arXiv — Machine Learning research 12d ago Role-guided Speaker Deletion Verification in Clinical Psychiatry Speech Recordings with Audio Language Models arXiv:2609.38491v1 Announce Type: new Abstract: Clinical research in psychiatry increasingly relies on large scale collection of spoken language data to identify acoustic and linguistic biomarkers. Yet evolving consent and protocol requirements can oblige investigators to remove… 27 r/LocalLLaMA community 12d ago I "built" a local LLM radio like the Pharaohs built the pyramids My local stack is a couple DGX Sparks, a 5090, and a 4070 TI. This radio site took three local LLMs, and we generate music, voices, and wacky sound effects. I give you https://pilgrim.farm It's a lot more farm than pilgrim.   submitted by   /u/jwhh91 [link]  … 25 ElevenLabs official-blog 13d ago Pronunciation dictionary guide: Fix any word in TTS on Eleven v4 Fix TTS pronunciation in TTS models with a pronunciation dictionary. Learn how to use alias and phoneme rules, plus inline IPA for one-off fixes. 26 ElevenLabs official-blog 13d ago ElevenLabs launches in the Netherlands ElevenLabs launches in the Netherlands, opening an Amsterdam office and tripling its local team to bring voice AI to Dutch enterprises. 21 NVIDIA Developer Blog official-blog 13d ago Fine-Tuning NVIDIA Nemotron for Saudi Arabic Dialects, with a Path to Other Languages Automatic speech recognition must handle how people actually speak, not only the languages and styles that dominate pretraining data. Regional dialects and... 35 arXiv — NLP / Computation & Language research 13d ago Automatic estimation of verbal fluency index in people with Motor Neuron Disease using ASR alignment and pause modelling arXiv:2609.38203v1 Announce Type: new Abstract: Monitoring cognitive impairment (CI) in motor neuron disease (MND) is essential for timely treatment and care, yet challenging due to co-occurring speech difficulties. The Edinburgh Cognitive and Behavioural ALS Screen (ECAS)… 13 arXiv — NLP / Computation & Language research 13d ago TutlAit v1: a crowdsourced Moroccan Tamazight speech dataset with Arabic transcriptions and regional accent labels arXiv:2609.38219v1 Announce Type: new Abstract: Tamazight (Amazigh) is, together with Arabic, one of the two official languages of Morocco, yet it remains severely under-resourced for speech technology: pub licly available labelled audio is scarce, generally lacks information on… 26 arXiv — NLP / Computation & Language research 13d ago Fairness Beyond a Single Run: Training-Seed Variability in Speech LLM Adaptation arXiv:2609.38976v1 Announce Type: new Abstract: Demographic fairness gaps in automatic speech recognition are almost always reported from a single training run. We fine-tune the Q-former projector and LoRA adapters of a speech LLM at five audio compression factors and six random… 21 arXiv — NLP / Computation & Language research 13d ago DuplexAct-Bench: Broadening Full-Duplex Speech Evaluation toward Proactive Interaction across Diverse Behavioral Requirements arXiv:2609.39446v1 Announce Type: new Abstract: Existing full-duplex speech benchmarks cover only subsets of real-time interaction behaviors, often under limited contextual conditions. We introduce DuplexAct-Bench, a bilingual benchmark that systematically covers six… 28 r/LocalLLaMA community 13d ago Astrabox - Open source Arcade Game Generator Hey everyone! I’ve been working on ASTRABOX : an arcade interface where you describe a game, the AI builds it, and you can ask for changes by voice while playing. Each game gets its own visuals and gameplay, while a shared runtime handles controllers, scores, player joining,… 8 r/LocalLLaMA community 13d ago peculiar-ragdoll's Dirk-Qwen 3.8-27B vs. UkisAI Swift-1.5 Qwen3.8-27B I have a long list of my own domain specific eval questions that I run to validate which models I can rely on: coding, coding (numpy/pandas), data analytics decision making, local RAG, and voice assistant. It's made up of the types of things I'm likely to deal with on the daily.… 6 TechCrunch — AI news-outlet 14d ago AI voice startup ElevenLabs doubles valuation to $22B The $300 million employee tender was co-led by Wellington and T. Rowe Price. 25 ElevenLabs official-blog 14d ago The Eleven v4 Audio Tags list: Try them, then write your own Browse the ElevenLabs Audio Tags list for Eleven v4, from emotions to sound effects, and learn to write your own tags with natural language in the TTS app. 16 ElevenLabs official-blog 14d ago ElevenLabs launches in Belgium ElevenLabs launches in Belgium with a new Brussels office, expanded local team, and multilingual AI voice agents for enterprises and government. 34 r/LocalLLaMA community 14d ago Oído: speech recognition that beats Whisper-tiny, running on a $5 microcontroller (open source) I'm part of the Lokutor team that built this. Model: NVIDIA Conformer-CTC Small (13M params, int8). It runs on an ESP32-S3 with 8 MB PSRAM, no GPU or NPU. LibriSpeech WER is 3.7 / 8.2, versus 6.3 / 15.9 for Whisper tiny.en on a laptop. Under real noise (DEMAND: car, kitchen,… 16 arXiv — NLP / Computation & Language research 14d ago FD-VAD: Semantic Endpoint Detection for Streaming Full-Duplex Speech arXiv:2609.35791v1 Announce Type: new Abstract: Natural turn-taking in full-duplex voice interaction requires determining from partial speech whether a pause reflects hesitation or a completed conversational intent. Acoustic voice activity detection lacks this semantic… 30 arXiv — NLP / Computation & Language research 14d ago Developing an OCR model for Extracting Information from Invoices with Korean Language arXiv:2609.35796v1 Announce Type: new Abstract: Invoices are commercial documents that contain various pieces of information, including the purchased items, time, and total money. Making the extraction of important information crucial. The stored information serves different… 35 arXiv — NLP / Computation & Language research 14d ago $\tau$-Multilingual: Benchmarking Voice Agents Across Languages arXiv:2609.35820v1 Announce Type: new Abstract: English-only benchmarks expose only a narrow slice of voice-agent behavior. We introduce $\tau$-Multilingual, extending $\tau$-Voice to Spanish, Brazilian Portuguese, Hindi, Korean, and Mandarin with native-speaker review and… 26 arXiv — NLP / Computation & Language research 14d ago Almost Human, Except When It Matters: VoxParity and the Decisions a Voice Should Change arXiv:2609.35922v1 Announce Type: new Abstract: A voice agent can handle almost every call on the words alone and still fail the few its sector's rules were written for. Emergency-call standards, fraud guidance, radio phraseology and vulnerability rules recognise that how a… 37 arXiv — NLP / Computation & Language research 14d ago MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversation arXiv:2609.36903v1 Announce Type: new Abstract: End-to-end full-duplex speech models have brought open-source machine conversation closer to human-like interaction, yet existing systems remain limited in two intertwined dimensions: long-context robustness and multi-party… 38 arXiv — NLP / Computation & Language research 14d ago BaLEEN: Biasing with Latent Encoded Entities for Context-Aware ASR arXiv:2609.36913v1 Announce Type: new Abstract: Transcribing domain-specific entities and rare proper nouns remains a major challenge in automatic speech recognition (ASR). In this paper, we propose BaLEEN (Biasing with Latent Encoded Entities), a lightweight, hypernetwork-based… 22 arXiv — NLP / Computation & Language research 14d ago Benchmarking Automatic Speech Recognition Tools for Iberian Languages arXiv:2609.36920v1 Announce Type: new Abstract: Comprehensive evaluations of automatic speech recognition (ASR) for Iberian languages remain limited, and low-resource languages, biases, and efficiency trade-offs are underexplored. We benchmark eleven systems, ten open-weight… 38 Page 2 of 10 · 500 articles ← Newer Older →