News / #music Tag Music 430 articles archived under #music · RSS Sign in to follow arXiv — NLP / Computation & Language research 1mo ago An Evaluation Framework for Structured Audio Captions Validated by Controlled Perturbations arXiv:2607.21424v1 Announce Type: new Abstract: Recent advancements in automated audio captioning (AAC) have shifted from monolithic sentence generation toward structured formats that explicitly disentangle distinct acoustic and semantic properties. However, evaluating this… 8 r/LocalLLaMA community 1mo ago [audio.cpp] Release 0.4: Higgs Audio v3 TTS 4B (10x real time)+ Fish Audio S2 Pro in C++/GGML, full GGUF loading, Q8 speed and VRAM gains audio.cpp again :) Release 0.4 is out. The headline this time is new high-quality TTS coverage plus GGUF becoming a first-class across the project. What’s new: Added Higgs Audio v3 TTS 4B, Fish Audio S2 Pro, Voxtral Realtime ASR and two community models OuteTTS TTS and… 7 arXiv — NLP / Computation & Language research 1mo ago Abstraction Induces the Brain Alignment of Language and Speech Models arXiv:2602.04081v2 Announce Type: replace Abstract: Research has repeatedly demonstrated that intermediate hidden states extracted from large language models and speech audio models predict measured brain response to natural language stimuli. Yet, very little is known about the… 13 Hugging Face official-blog 1mo ago Bringing Nunchaku 4-bit Diffusion Inference to Diffusers Back to Articles a]:hidden"> Bringing Nunchaku 4-bit Diffusion Inference to Diffusers Published July 23, 2026 Update on GitHub Upvote 6 Pham Hong Vinh rootonchair guest Sayak Paul sayakpaul Large diffusion transformers can create stunning images (or even videos, audio snippets,… 22 arXiv — NLP / Computation & Language research 1mo ago Fusion Embedding: A Unified Embedding Space for Text, Image, Video, and Audio arXiv:2607.18666v1 Announce Type: new Abstract: A single embedding space that covers text, images, video, and audio lets one index serve every query a user can pose. Embedding models built on vision-language backbones now lead text/image/video retrieval benchmarks but lack audio… 36 arXiv — NLP / Computation & Language research 1mo ago From a Multilingual Streaming ASR Backbone to Kenyan-Language Systems: Data-Centric Adaptation of Nemotron 3.5 for Kikuyu, Dholuo, and Kalenjin arXiv:2607.18912v1 Announce Type: new Abstract: Automatic speech recognition (ASR) for African languages is constrained by orthographic inconsistency, annotation artifacts, missing audio, speaker and domain imbalance, and evaluation procedures that differ from deployment. We… 24 Vercel — AI dev-tools 1mo ago AI Gateway now supports streaming transcription AI Gateway now supports streaming transcription . Previously, transcription required a complete audio file and returned the full transcript in a single response. Now you can stream audio in as it's captured and get transcript updates back as the model produces them, keeping… 20 TechCrunch — AI news-outlet 1mo ago AI and the rise of the universal entertainment app Over the past decade, streaming platforms competed by dominating individual formats like music, video, podcasts, or audiobooks. Now, as AI makes it easier to create, organize, and recommend content, those distinctions are fading, pushing companies like Spotify, Netflix, YouTube,… 17 r/LocalLLaMA community 1mo ago Today I learnt the power of LocalLlama DISCLAIMER: No Ai was prompted in the creation of this post. Today I had an experience that complely blew my mind, I just had to write it down. As a bit of background I have been dabbling prompting local models using LM studio for the better part of 18 months now, keeping up to… 38 arXiv — NLP / Computation & Language research 1mo ago ESCUCHA: A Spanish Speech Benchmark for Heterogeneous Acoustic Conditions arXiv:2607.17812v1 Announce Type: new Abstract: As large audio language models (LALMs) advance, robust evaluation frameworks have become essential. In this context, Spanish speech understanding under realistic acoustic conditions has received particularly little attention. We… 6 arXiv — NLP / Computation & Language research 1mo ago Modeling turn-taking with distant viewing: investigating silence thresholds in human and AI-generated discourse arXiv:2607.18076v1 Announce Type: new Abstract: This study investigates silence gaps in two kinds of audiovisual material. We analysed thirty US situational comedies and fifty-one synthetic podcasts generated with Google NotebookLM. Gaps were compared across speaker gender,… 4 r/LocalLLaMA community 1mo ago Trellis.cpp now has a studio! When Trellis.cpp released, people were rightly complaining that while the port was nice, the usability barrier was still high since you had to navigate the command line and fetch all the weights manually. So now, Trellis.cpp has a built-in simple Studio binary: picks the proper… 19 r/LocalLLaMA community 1mo ago Introducing Scylla's Band, a new TTS model + inference framework with Android sample! Hey all! https://github.com/lowkeytea/scyllasband -> inference code https://huggingface.co/spybyscript/scyllasband -> model, LiteRT, ONNX, and voices https://lowkeytea.github.io/scyllasband/ -> sample audio for the voices, emotions, and languages. The tldr: 10 voices, 7… 13 Hugging Face Daily Papers research 1mo ago Qwen-Music Technical Report Abstract In this report, we introduce Qwen-Music, a powerful music generation model capable of producing highly musical and high-fidelity songs with complete vocal singing. Qwen-Music supports two core tasks: Text to Music Generation, which create entirely new songs from text… 9 arXiv — Machine Learning research 1mo ago AV-JEPA: Extending LeJEPA to Audio-Visual Self-Supervised Learning arXiv:2607.15295v1 Announce Type: cross Abstract: We present AV-JEPA, an elegant multimodal extension of LeJEPA to audio-visual self-supervised learning. Using an early-fusion Vision Transformer and modality dropout as masking, the model is trained to align the embeddings of… 31 arXiv — NLP / Computation & Language research 1mo ago Controlling Implicit Shortcut Reliance in L2 Spoken English Auto-markers arXiv:2607.16085v1 Announce Type: new Abstract: Increasingly, speech and language processing tasks take either audio or text directly rather than extracting features from these as the input to the classifier or regressor. Often these systems make use of complex, for example… 17 Hugging Face Daily Papers research 1mo ago Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos Abstract We present Audio-Visual Flamingo (AV-Flamingo), a fully open state-of-the-art audio-visual large language model (AV-LLM) for joint understanding and reasoning over audio, images, and long-form videos. Unlike prior AV-LLMs that primarily focus on short clips, AV-Flamingo… 9 r/LocalLLaMA community 1mo ago Hey Qwen Team: We Need a 100B MoE Model for Spark! Are there any Qwen team members here? Please release a 100B MoE model that I can run on Spark!   submitted by   /u/absurd-dream-studio [link]   [comments] 8 r/MachineLearning community 1mo ago TabFM Studio: point-and-click predictions on spreadsheets with tabular foundation models, fully local [P] I built a small web app that lets you run tabular foundation models (currently just Google's TabFM) on spreadsheets without writing any code. Just drop in a CSV/Excel file, click a column header to mark what to predict, hit predict. Rows where the target cell is filled become… 23 r/LocalLLaMA community 1mo ago Qwen and Gemma providers I like to use the MoE modles qwen3.6-35B and Gemma-4-26B. I noticed differences in result quality between versions from different providers, like bartowski, unsloth, lm-studio, google, etc. My tests dont give me a clear answer to though. Is there a rule if thumb which provider… 7 r/LocalLLaMA community 1mo ago Serving a fleet of Qwen3.5 122b sessions on a single Mac Studio (96GB) without losing your sanity Hello all Just following up on a post I made last week about my experiment to try minmax my Mac Studio. In particular, I've had quite a lot of success with pushing things even further. Across a 20 minute test with three concurrent sessions, my Mac Studio was offered 789,351… 5 Hugging Face Daily Papers research 1mo ago WanSong v1.0 Technical Report Abstract Music generation foundation models have recently attracted significant industry attention. However, achieving efficient generation and high-fidelity long-form audio while supporting controllability remains challenging. To address these needs, we present WanSong, a… 19 arXiv — NLP / Computation & Language research 1mo ago TikStance: A Multimodal and Hierarchical Dataset for Multi-target Stance Analysis in TikTok Political Conversations arXiv:2607.15240v1 Announce Type: new Abstract: Political discourse has increasingly moved to short-video platforms, yet computational analysis of such content remains constrained by the scarcity of datasets that jointly preserve audiovisual information and hierarchical… 15 Hugging Face Daily Papers research 1mo ago MultiRef-Compass: Towards Comprehensive Evaluation of Multi-Reference-to-Audio-Video Generation Abstract Multi-reference-to-audio-video (MR2AV) generation aims to generate coherent audio-video content conditioned on multiple references and textual instructions. Existing benchmarks mainly focus on text-driven generation, single-reference subject preservation, or isolated… 11 r/LocalLLaMA community 1mo ago Introducing LM Studio Bionic   submitted by   /u/pegasus912 [link]   [comments] 22 Hacker News — AI on Front Page community 1mo ago LM Studio Bionic: the AI agent for open models Article URL: https://lmstudio.ai/blog/introducing-lm-studio-bionic Comments URL: https://news.ycombinator.com/item?id=48939662 Points: 201 # Comments: 73 5 arXiv — Machine Learning research 1mo ago A Hybrid Mamba for Audio-Visual Navigation arXiv:2607.13110v1 Announce Type: new Abstract: Since the paradigm centered on convolutional neural networks and recurrent architectures was established in 2020, the fundamental backbone networks for audio-visual navigation have undergone no essential changes for more than five… 21 TechCrunch — AI news-outlet 1mo ago Hack suggests AI music generator Suno scraped YouTube for training data The hacker used an employee's credentials to access source code, which revealed how Suno scraped decades of audio. 29 Smol AI News news-outlet 1mo ago not much happened today **Thinking Machines Lab** launched **Inkling**, its first fully released open-weights foundation model family, featuring **975B parameters** with **41B active parameters** in a **Mixture-of-Experts** architecture. Inkling supports **multimodality** with text, image, and audio… 20 arXiv — Machine Learning research 1mo ago PolarBM: Complex-valued Boltzmann Machine for Modeling Audio Signals in Polar and Log-polar Coordinates arXiv:2607.12417v1 Announce Type: new Abstract: Although vast amounts of data, such as audio signal spectra, are naturally represented using complex numbers, conventional machine learning methods often simplify complex-domain problems by employing frameworks designed for… 4 arXiv — NLP / Computation & Language research 1mo ago The Sound of Absence: Audio-Language Embedding Models Struggle with Negation arXiv:2607.12290v1 Announce Type: cross Abstract: Audio-language embedding models such as CLAP are widely evaluated on matching present sound events, but rarely on negation. We show this affirmation-only evaluation hides a key limitation: these models fail to encode negated… 5 arXiv — NLP / Computation & Language research 1mo ago Do We Really Need Multimodal Emotion Language Models Larger Than 1B Parameters? arXiv:2607.12787v1 Announce Type: cross Abstract: Recent advances in multimodal large language models (MLLMs) have significantly improved the performance of multimodal emotion recognition (MER) and enabled interpretable description generation by jointly modeling video, audio,… 18 r/LocalLLaMA community 1mo ago [audio.cpp] 10 hours of audio generated in 3 minutes on RTX 5090 (demo included)! C++/GGML based Supertonic 3, MOSS-TTS, IndexTTS2, and Irodori-TTS released audio.cpp again. Hopefully you are not sick of it yet :) Release 0.3 adds five new models: Supertonic 3, MOSS-TTS-Local, MOSS-TTS-Nano, IndexTTS2, and Irodori-TTS. The highlight is Supertonic 3. It can hit 200 ×+ real time on CUDA (RTX 5090), 6×+ on CPU, and around 47 ms TTFT in… 37 Vercel — AI dev-tools 1mo ago Inkling from Thinking Machines is now available on AI Gateway Inkling from Thinking Machines is now available on AI Gateway. Inkling is a broad generalist model, trained across agentic, reasoning, coding, instruction-following, factuality, vision, and audio tasks rather than optimized for a single domain. The model also supports… 12 r/LocalLLaMA community 1mo ago GLM-5.2-Int4-Int8 on 8× GB10: ~1,200 t/s prefill, 33–54 t/s avg decode GLM-5.2-Int4-Int8 on 8× GB10: ~1,200 t/s prefill, 33–54 t/s avg decode (generic - coding/structured) and memory remaining to run also a Mimo 2.5 in parallel for image/audio input, both tp 8. https://x.com/i/status/2077123292352204943   submitted by   /u/ciprianveg [link]… 9 TechCrunch — AI news-outlet 1mo ago The founder of Hinge raised $18M to build a new AI dating service, Overtone Overtone describes itself as "a voice- and audio-forward service, enabled by AI, that provides highly curated introductions." 26 TechCrunch — AI news-outlet 1mo ago Spotify expands its AI push with a ChatGPT-like music assistant Spotify is rolling out a new AI-powered conversational feature that lets Premium subscribers chat with the app to discover music, podcasts, audiobooks, and more. 8 arXiv — Machine Learning research 1mo ago Empowering Long-form Omni-modal Understanding with Robust Audio Perception arXiv:2607.10299v1 Announce Type: new Abstract: Recent advances in large-scale multimodal models have drivenremarkable progress in vision-language tasks; however, comprehensiveomni-modal understanding remains under-explored, largely due to thescarcity of datasets with rich,… 8 arXiv — NLP / Computation & Language research 1mo ago LightMem-Ego: Your AI Memory for Everyday Life arXiv:2607.11487v1 Announce Type: new Abstract: Personal AI assistants on mobile and wearable devices continuously perceive users' daily lives through visual and audio streams. However, answering queries about past experiences requires lightweight multimodal memory that can… 13 Hugging Face Daily Papers research 1mo ago LightMem-Ego: Your AI Memory for Everyday Life Abstract Personal AI assistants on mobile and wearable devices continuously perceive users' daily lives through visual and audio streams. However, answering queries about past experiences requires lightweight multimodal memory that can continuously accumulate, organize, and… 10 arXiv — Machine Learning research 1mo ago Clean2FX: Label-conditioned modeling for clean-to-effect guitar audio transformations arXiv:2607.08863v1 Announce Type: cross Abstract: We present Clean2FX, a study and demo of label-conditioned clean-to-effect transformation for electric guitar audio. Given a clean guitar input and a target effect label, the task is to synthesize the corresponding effected… 10 r/LocalLLaMA community 1mo ago Running Qwen3.5-122B on Mac Studio 96GB: Fixed 3 bugs that made long-context inference usable Hey everyone, I recently switched from DS4 Flash to Qwen3.5-122B on my M3 Ultra Mac Studio for long-context agentic coding. While the model fit better, I hit a wall where follow-up messages took 3-5 minutes to start generating (cold fills) despite having a "warm" context. Turns… 22 llama.cpp releases dev-tools 1mo ago b9980 server: Don't consider models with --no-mmproj-auto as multimodal ( #25590 ) If mmproj is explicitly disabled via the model preset or command-line parameters then the model won't be able to handle image/audio inputs and this shouldn't be declared as supported input modality on… 25 r/LocalLLaMA community 1mo ago LM Studio + Zoo + Qwen 3.6 issues I'm currently running an Unsloth quant of Qwen3.6-35B-A3B and I've managed to speed up my output to ~80 tk/s by offloading all experts to CPU. I'm on a Legion 7i laptop, 5080 with 16 GB VRAM. I mainly use the models for Zoo (formerly Roo) integration into VSCode. I'm running… 38 Hacker News — AI on Front Page community 1mo ago Show HN: Juggler – an open-source GUI coding agent, by the creator of JUCE Hello HN, I don't post on here much, but wanted to get some eyes on a new project I'm just launching. I think we definitely need one more AI code agent.. I'm a long-term C++ dev, and over 30+ years I've created some successful audio dev tools (JUCE, the Tracktion DAW, the Cmajor… 11 r/LocalLLaMA community 1mo ago If you use Open Code or other agenting programs you are leaving a lot of t/s if you don't actually use agents in parallel. Benchmark : RTX5090, Qwen3.6 35B loaded via LM studio with parallel tasks set to 8 As many of you know t/s is super important. It's how fast your stuff gets done. I create via open code benchtest and run it. Thanks to it i know that if i don't run at least 4 agents i basically leave HALF of performance. So whatever you do single project in open code that uses… 34 r/LocalLLaMA community 1mo ago Hy3 (295B MoE) and NVIDIA Nemotron-Labs-Audex-30B-A3B (audio-capable 30B MoE) GGUF quants Sharing two GGUF quant sets, both with the same treatment: imatrix quantization, KLD/PPL measured against BF16 reference logits, llama-bench throughput numbers, and all raw benchmark data included in the repos. No vibes-based "quality tested" claims — every number is… 16 r/LocalLLaMA community 1mo ago Second drive Do I really need to upgrade my main drive with OS or I just can save a little bit by keeping 480GB SSD for OS and LM Studio and just add SN7100 as second drive for models and other projects? Will it somehow affect inference speed or only Windows and LM Studio starting time?… 10 Hugging Face Daily Papers research 1mo ago A Quantized Native Runtime for On-Device Semantic Audio Generation Abstract A dependency-free runtime enables efficient text-to-music generation on embedded devices through quantization and activation steering while maintaining audio quality. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Semantic audio applications increasingly require… 22 arXiv — NLP / Computation & Language research 1mo ago Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks arXiv:2607.07907v1 Announce Type: cross Abstract: With the growing adoption of VLMs, DMs, LLMs, and AFMs, these multimodal foundation models can inadvertently encode sensitive, copyrighted, biased, or unsafe cross-modal associations that originate from their training data.… 4 Page 4 of 9 · 430 articles ← Newer Older →
