News / #music Tag Music 500 articles archived under #music · RSS Sign in to follow llama.cpp releases dev-tools 1mo ago b10580 mtmd: support dots3-note vision+audio ( #27524 ) text: conversion init impl mtmd: conversion impl mtmd cpp Update gguf-py/gguf/tensor_mapping.py Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co… 22 r/LocalLLaMA community 1mo ago I tried to do agenic coding with Qwen 3.8 27B 3bit quant on a macbook air m2 24gb. It took 63 hours, but amazingly, the flight simulator worked. I used LM Studio Bionic with Qwen 3.8 27B Q3_K_S with 57k context. It took a staggering 63 hours to finish coding. After the first prompt "Create a beautiful, relaxing flight simulator in a single HTML page" taking 47.8 hours, it created an html file that showed the title screen… 15 r/LocalLLaMA community 1mo ago I feel like I finally graduated. I finally made the move from LM Studio to vLLM thanks to this post https://www.reddit.com/r/LocalLLaMA/s/NmS9CgHvqz . I may not know what it all means yet but I’m going to start diving into the docs to learn as much as I can. I’m running an endpoint on each of my 3090s one for… 4 r/LocalLLaMA community 1mo ago model: add dots3-note by ngxson · Pull Request #27060 · ggml-org/llama.cpp dots3-note preview is the first open-weight model in the dots3 family. It is a Mixture-of-Experts model with 280B total parameters, 16B activated parameters, and support for a context length of up to 512K tokens. The model can understand text, images, video, and audio, and… 14 r/LocalLLaMA community 1mo ago FireRedAudio & FireRedTTS3 by FireRedTeam - Huggingface FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generation HuggingFace : https://huggingface.co/FireRedTeam/FireRedAudio GitHub : https://github.com/FireRedTeam/FireRedAudio Demo :… 33 r/LocalLLaMA community 1mo ago Ultrafast Qwen3-TTS at 34 ms Time-to-First-Audio, Handling 10 Requests Per Second [OSS] Hey locallama! We recently open sourced a Qwen3-TTS 1.7B implementation that achieves 10 requests per second (RPS) and sub-50 ms p95 time-to-first-audio (TTFA) while maintaining real-time playback on 1 x H100. This extends to 20 RPS at sub-100 ms p95 TTFA. By adjusting settings,… 31 Google DeepMind official-blog 1mo ago From Atari to EVE Online: Building on 15 Years of AI Research in Games Google DeepMind partners with game studios to prototype breakthrough AI gameplay. 28 Hugging Face Daily Papers research 1mo ago Listening Forward: Next Patch Embedding Prediction Enables Scalable Audio Learners Abstract NAPE uses causal Transformers to predict successive spectrogram patch embeddings for self-supervised audio learning without auxiliary components. Generated by thinkingmachines/Inkling-Small Self-supervised learning (SSL) has driven substantial progress in audio… 6 Hugging Face Daily Papers research 1mo ago Towards Quantifying Benchmark Optimization in ASR Models Abstract High-performing speech recognition models reproduce benchmark transcripts despite contradictory audio, revealing benchmark-optimized behaviors that inflate scores without improving real-world transcription. Generated by thinkingmachines/Inkling-Small Public benchmarks… 13 arXiv — NLP / Computation & Language research 1mo ago Represented but Ignored: A Causal Account of Prosodic Underuse in Audio-Language Models arXiv:2608.19211v1 Announce Type: new Abstract: Human speech is richly expressive, with prosody carrying linguistic and emotional information beyond the lexical content. A capable large audio-language model (audio-LLM) should therefore support expressive speech understanding,… 4 r/LocalLLaMA community 1mo ago Make Jensen Huang Sound Like Anyone. New Streaming Voice Conversion Model MeanVC2 Released! Finally see a new voice conversion model. MeanVC2 supports cross-gender and cross-language voice conversion. 3x realtime on CPU with audio.cpp. Disclaimer: The converted voice quality of MeanVC2 is decent; the noise comes from my rough demo engineering, not the model itself.… 38 Hugging Face Daily Papers research 1mo ago VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation Abstract A human-aligned chain-of-thought reward model and preference dataset improve joint video-audio generation by replacing fragmented metrics with coherent, dimension-wise reinforcement learning. Generated by thinkingmachines/Inkling-Small Using reinforcement learning to… 29 Hacker News — AI on Front Page community 1mo ago AliExpress runs silent WebAudio fingerprinting that breaks Bluetooth multipoint Article URL: https://blog.laserphile.com/2026/08/aliexpress-webpage-keeping-multipoint.html Comments URL: https://news.ycombinator.com/item?id=49372583 Points: 368 # Comments: 122 23 arXiv — NLP / Computation & Language research 1mo ago Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models arXiv:2608.18132v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are typically built through a multi-stage pipeline consisting of cross-modal alignment, supervised fine-tuning (SFT), and preference optimization. This pipeline assumes that adapting an LLM… 30 r/LocalLLaMA community 1mo ago Finally found a really solid suno-like minimax music UI!! Been messing with minimax music gen lately. I really like Suno and was basically looking for something that gave me a similar workflow for minimax. I got completely sick of running everything through the CLI. I went digging on github, sorted by recent, and took a gamble on this… 8 Vercel — AI dev-tools 1mo ago Fish Audio models now available on Vercel AI Gateway for free Fish Audio 's audio models are now available on AI Gateway. To celebrate the launch, every Fish Audio model is free on AI Gateway for the next 30 days, through September 18. Capability Regular Through September 18 Text-to-speech $15.00 per million characters Free Speech-to-text… 22 Hacker News — AI on Front Page community 1mo ago Claude writing a macOS driver for my obscure HP printer built only for Windows https://xcancel.com/kuberwastaken/status/2089377982536388964 https://cdn.kuber.studio/chat/hp-laser-1008a-driver Comments URL: https://news.ycombinator.com/item?id=49344643 Points: 248 # Comments: 185 5 r/LocalLLaMA community 1mo ago Qwen 3.8 27B is faster than expected i ran this model on my two 5060 TI 16GB cards at Q4 in unsloth and LM studio ( i downloaded NVFP4 but didn't try it in vLLM ) i think it runs faster than expected it gives me 50 - 60 t/s with MTP. this is surprising because it's a dense model and Qwen 3.6 was giving me 30t/s… 34 Hugging Face Daily Papers research 1mo ago Prototype-Rectified Iterative Self-supervised Manifold Denoising under Severe Acoustic Shift Abstract PRISM is a fast, training-free test-time adaptation method that reverses low-rank affine noise distortions in audio-text models using frozen text prototypes and geometric corrections. Generated by thinkingmachines/Inkling-Small Audio-Text Foundation Models (ATMs) fail… 33 arXiv — Machine Learning research 1mo ago DeaMoE: Efficient MoE Structure for Fast Small-Batch Decoding arXiv:2608.14385v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models have been widely adopted in real-time interactive applications such as coding assistants, real-time audio-video interaction systems. To meet the extremely low response latency requirements of these… 26 arXiv — NLP / Computation & Language research 1mo ago Measuring Fairness in Large Audio Language Models via Semantic-Aware Bias Estimation arXiv:2608.13624v1 Announce Type: new Abstract: Large Audio Language Models (LALMs) have seen increasing use for audio understanding tasks such as speech recognition and audio question answering, raising concerns about fairness across demographic subgroups. Fairness evaluation… 7 arXiv — NLP / Computation & Language research 1mo ago StreamHear: Domain-Adapted Pseudo-Labeling for Semi-Supervised Streaming Speech Recognition arXiv:2608.13717v1 Announce Type: new Abstract: Streaming automatic speech recognition (ASR) underperforms on domain-shifted target audio, where labeled in-domain data is costly to prepare while unlabeled audio is abundant. We present StreamHear, a semi-supervised pipeline that… 19 arXiv — NLP / Computation & Language research 1mo ago Lost in Phonation: Voice Quality Variation as an Evaluation Dimension for Speech Foundation Models arXiv:2510.25577v2 Announce Type: replace-cross Abstract: Recent advances in Speech Foundation Models (SFMs) enable direct processing of raw audio, allowing models to respond to subtle paralinguistic variation. However, how these models interpret non-lexical cues remains largely… 6 r/LocalLLaMA community 1mo ago [audio.cpp] Release 0.6: dots.tts, MiniMax-H3 text2audio (up to 3x realtime), MiniMax-Music3 (preview), and more new audio models. 5+ demos included. Hi all :) audio.cpp release 0.6 has been out for a little while, so this is more of an update on what landed and what has been improving around it. 0.6 added 5 new model families: dots.tts, NeuTTS-2e, MuScriptor (Music to MIDI), MiniMax-H3, and SenseVoice-Small, bringing… 25 r/LocalLLaMA community 1mo ago 5090: Windows or Linux for Qwen3.8.27b I've got a dedicated AI rig sitting here with a RTX 5090 and 96GB RAM and for the past few years have been using Windows 11 and primarily LM Studio, but have also used vLLM, llama.cpp and Ollama. With Qwen3.8.27b I want to get the most out of this model. I get the feeling from… 14 Simon Willison community 2mo ago CORS Chat Tool: CORS Chat I built this today ( with GPT-5.6-Sol xhigh ) to help test Qwen 3.8 27B running in LM Studio on both my M5 MacBook Pro and an NVIDIA DGX Spark. It provides a web UI for exercising an OpenAI-Responses-compatible chat endpoint. I've tried it against LM Studio with… 36 r/LocalLLaMA community 2mo ago (Newbie) what do you use local models for? I’m a long time lurker and have a newbie rig. i run Qwen 3.6 27B and I use LM studio. I use it to summarize long and terse financial and legal documents that I don’t want to upload to cloud. that isn’t everyday though and I am not really learning anything new. id like for this… 32 r/LocalLLaMA community 2mo ago Recommend harness for local coding? I am looking to start coding locally with qwen3.8 27B, but what is a good harness + backend for this? LM studio is not cutting it   submitted by   /u/Desperate-Data-3747 [link]   [comments] 25 r/LocalLLaMA community 2mo ago Does anyone else suddenly experience unusually fast model loading times? In the last week or so, in LM Studio, i've had models load into memory very fast for some reason, even when i'm loading them from HDD. I know that if you just had a certain model in memory, ejected it, and then try to reload it right away, it often loads almost instantly,… 13 Hugging Face Daily Papers research 2mo ago From Inaudible Inputs to Model Failures: Low-Frequency Safety Risks in LALMs Abstract Researchers propose a black-box red-teaming method using inaudible low-frequency waveforms to expose vulnerabilities in audio-language models, alongside a defense that detects distribution shifts and requests a second recording to recover accuracy. Generated by… 37 Hugging Face Daily Papers research 2mo ago UniSwap: Streaming Audio-Visual Identity Swapping for Talking Videos Abstract UniSwap enables synchronized appearance and voice replacement in talking videos through a unified streaming audio-visual diffusion transformer with specialized training and inference adaptations. Generated by thinkingmachines/Inkling-Small Talking-video character… 31 arXiv — NLP / Computation & Language research 2mo ago EgoCITE: Context-Augmented Indexing and Time-Aware Retrieval for Long-Horizon Egocentric Memory arXiv:2608.12627v1 Announce Type: cross Abstract: Long-horizon egocentric memory transforms continuous first-person video and audio into a searchable record of past experiences. We demonstrate two bottlenecks in existing systems: indices built from context-poor captions are… 11 r/LocalLLaMA community 2mo ago 1BIT Qwen 3.8 2.4T a95b (unsloth iQ1_S) (MEDIUM Reasoning) Processing img az99qopcg8jh1... So same as my prior post 1bit test... although this 1bit is a bit interesting you can read on unlsoth blog https://unsloth.ai/docs/models/qwen3.8 508 gigs being used I am using unsloth studio on the mac ultra 512. Im getting ~50pp and ~9.6 tgen… 28 r/LocalLLaMA community 2mo ago dots-studio/dots3-note-prev · Hugging Face dots3-note preview is the first open-weight model in the dots3 family. It is a Mixture-of-Experts model with 280B total parameters, 16B activated parameters, and support for a context length of up to 512K tokens. The model can understand text, images, video, and audio, and… 27 r/LocalLLaMA community 2mo ago Minimax Music 3 open weight release soon? Diffusers has a PR with deets: https://github.com/huggingface/diffusers/pull/14456 Minimax is working on this repository right now and put up a bunch of samples: https://github.com/MiniMax-AI/music3-demo/tree/main/assets/audio/tracks Comfy-Org is teasing about a big release in… 30 arXiv — NLP / Computation & Language research 2mo ago Easper: An Accessible ASR Pipeline for Language Documentation arXiv:2608.11629v1 Announce Type: new Abstract: Audio transcription is a critical bottleneck in language documentation. While multilingual Automatic Speech Recognition (ASR) models like Whisper offer solutions, field linguists often lack the expertise to utilise them. We present… 4 arXiv — NLP / Computation & Language research 2mo ago Robust Multi-Tier Infant-Centered Audio Understanding with Whisper via Structured Speaker Conditioning arXiv:2608.11587v1 Announce Type: cross Abstract: Recent advances in model design and self-supervised audio representations have improved speech and audio understanding, yet infant-centered naturalistic recordings remain challenging due to limited labeled data, low… 18 arXiv — NLP / Computation & Language research 2mo ago Confucius4-TTS: Transcript-Free Cross-Lingual Zero-Shot TTS with a Learnable Speaker Encoder arXiv:2608.11650v1 Announce Type: cross Abstract: Recent advances in zero-shot text-to-speech (TTS) have substantially improved speech quality and voice cloning fidelity. However, many zero-shot TTS systems still depend on audio prompt transcripts at inference time. This… 8 Hugging Face official-blog 2mo ago Introducing OlmoEarth embeddings: Custom embedding exports from OlmoEarth Studio for downstream analysis Back to Articles a]:hidden"> Introducing OlmoEarth embeddings: Custom embedding exports from OlmoEarth Studio for downstream analysis Enterprise Article Published August 12, 2026 Upvote 1 Kyle Wiggers Ai2Comms allenai 📄 Tech Report: https://allenai.org/papers/olmoearth | 📊… 9 Hacker News — AI on Front Page community 2mo ago Show HN: Woxi - Open-source Mathematica / Wolfram Language reimplementation Woxi is an interpreter for the Wolfram Language written in Rust. It comes with Woxi Studio, a Mathematica-like GUI built with iced, but you can also use Woxi through a CLI, Jupyter kernel, Python package, npm package, or WASM module. Compared with wolframscript / Mathematica,… 28 OpenAI Python SDK releases dev-tools 2mo ago v2.54.0 2.54.0 (2026-08-11) Features api: Add new Responses model identifiers ( #3595 ) ( 0652787 ) Bug Fixes api: clarify audio upload metadata requirements ( #3596 ) ( 28888f9 ) Chores api: Update generated-file header attribution to Castiron ( #3583 ) ( ea17fda ) 23 r/LocalLLaMA community 2mo ago Introducing Unsloth Desktop app Hi LocalLlama, we're super excited to release Unsloth Desktop today! 🦥 It's the first desktop app that enables you to run and train models locally. Open-source. Available on Mac, Windows, and Linux Supports MLX, diffusion image/video models, audio models, and GGUF You can run… 19 r/LocalLLaMA community 2mo ago Why have 8B-12B models been dropped? I am a Macbook Pro M4 user with the 16GB of unified ram. The best model I have been able to run on LM Studio is Gemma4 12B QAT, this model is 66 days old. After that the next best thing LM studio suggests is Nemotron 3 Nano 4B and Qwen3.5 9B, which both are 147-161 days old. It… 37 arXiv — NLP / Computation & Language research 2mo ago Multilingual Emotion Neurons in Large Audio-Language Models arXiv:2608.08772v1 Announce Type: new Abstract: Emotion is central to human communication, and its expression varies across languages. Large audio-language models (LALMs) achieve strong performance on multilingual speech tasks, yet it remains unclear whether they encode emotion… 23 arXiv — NLP / Computation & Language research 2mo ago REFRAMED: Towards Realistic Audio Description Generation for Movies arXiv:2608.09765v1 Announce Type: new Abstract: Audio Description (AD) is a verbal narration of key visual content in videos, enabling access for visually impaired audiences. Unlike standard video captioning, AD is a structured editorial task: descriptions must be inserted into… 35 arXiv — NLP / Computation & Language research 2mo ago Structured Phonological Representations for Audio-Articulatory rtMRI Speech Classification arXiv:2608.09767v1 Announce Type: new Abstract: Real-time MRI makes it possible to observe vocal-tract articulation during speech, but mapping these articulatory patterns to phonetic and phonological categories remains challenging. We investigate whether PhonoQ, an audio-based… 35 arXiv — NLP / Computation & Language research 2mo ago Comparing British and American Audio Description of Movies arXiv:2608.09792v1 Announce Type: new Abstract: Narrating the visual component of movies is known as audio description. It is a narrative technique designed to enable blind and visually impaired individuals to follow the story. However, it is far more constrained than most… 24 Simon Willison community 2mo ago Introducing Muse Glimmer Introducing Muse Glimmer Meta are back in the open weights game! Muse Glimmer is a brand new 30B model under a clean Apache 2.0 license (a step up from the janky Llama licenses of old). Here's a pelican which I generated using LM Studio's 18.16 GB version of the model : I really… 21 Hacker News — AI on Front Page community 2mo ago Humanising LLM Outputs Is Dumb Article URL: https://kuber.studio/blog/Reflections/Humanising-LLM-Outputs-is-Actually-Dumb Comments URL: https://news.ycombinator.com/item?id=49243474 Points: 200 # Comments: 131 5 r/LocalLLaMA community 2mo ago Chat UIs with native audio input for multimodal models? I've been running Gemma 4 E4B with oMLX and I can't find any chat interfaces that directly send the audio file to the model instead of running the audio through a separate STT layer. I can confirm the audio layers work because I ran a couple of requests through Pydantic AI in… 6 Page 5 of 10 · 500 articles ← Newer Older →
