Talking with Gemma 4 31B!
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| | Hi! I'm Andi from Hugging Face. This is a fully open-source and free to test/pull/modify demo I'm bringing today. It's a voice demo creating a pipeline of: It sees and searches the web faster than you blink. The whole stack is fully open-source, and is a drop-in replacement for OpenAI's realtime API. You can run it locally, I get similar latencies with a macbook pro M3 36GB and Gemma 4 E4B. Here to the web based demo featured in the video, everything is running in the cloud. For those who have been following, yes, this is the pipeline that runs on reachy minis :) [link] [comments] |
More from r/LocalLLaMA
-
deepseek-ai/DeepSeek-V4-Flash-Vision-Exp · Hugging Face
Aug 31
-
pipecat-ai/phonellm-alpha-1: GPT 5.6 Terra performance on typical voice agent tasks at 1/3 the latency and 1/18 the cost
Aug 31
-
Could this affect M5 Ultra price/availability?
Aug 31
-
GLM 5.3, GLM 5.3 Flash or 3.8 Qwen Flash for Replacing Kimi k3 IQ2_XXS
Aug 31
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.