Skip to content

Latest

r/LocalLLaMA Communities

[audio.cpp] What Does the Fox Say: 4 ASR models (Nemotron 3.5 ASR, Higgs Audio STT, VibeVoice ASR, and Hviske ASR) in native C++/GGML, init streaming support, and 327s of audio transcribed in 2.17s.

I just pushed a new audio.cpp update with streaming support and 4 ASR models: Nemotron 3.5 ASR, Higgs Audio STT, VibeVoice ASR, and Hviske ASR (da…

r/LocalLLaMA Communities

Which open models help the eco system more?

https://artificialanalysis.ai/evaluations/artificial-analysis-openness-index In case you want to support openness, some models are more open than others. Update: K2 think v2 is rated highest because it supplies its…

r/LocalLLaMA Communities

Can you explain the concept behind each of the main size ranges of LLM models, as in, what hardware setups the different size niches are meant to fit into (~30b, ~70b, ~120b, ~230b, etc). Like is it mainly based on pro hardware sizing for 8-bit, or consumer GPU vram for ~Q4, or some mixture?

I am curious about intended sizings of the main size niches of the popular local LLM models. As in, we can see there is a major…

r/LocalLLaMA Communities

Qwen3.5 122B is the best?

I’m using Opencode and a computer with 128gb. So maybe the results would be different on system. I’ve exhaustingly tried Qwen3.6 27B and Qwen3.6 33B. I…

r/LocalLLaMA Communities

What GUI-first coding tool tool are you pairing your local LLMs with? Opencode isn’t it for me.

I've grown very frustrated with OpenCode. The web GUI and desktop app ideas are good, but the execution not so much. The GUI is lacking so…

r/LocalLLaMA Communities

Grok 4.5 released – GLM-5.2 shows up in xAI’s own charts, 2.6 pts behind on SWE Bench Pro

https://x.ai/news/grok-4-5 Quick numbers from the launch page: $2/M input, $6/M output. Closed weights. No EU until mid-July. SWE Bench Pro: Fable 80.4% > Opus 4.8 69.2%…

r/LocalLLaMA Communities

What China Said at the UN’s First Global Dialogue on AI Governance

Open source AI is a shared asset for all humanity. Chinese open source models such as DeepSeek and Qwen have significantly lowered the barriers and costs…

r/LocalLLaMA Communities

4-bit GLM-5.2 (753B MoE) on 4× DGX Spark: 70.8% on Terminal-Bench 2.1 vs 81.0% for the full model

TL;DR: Full GLM-5.2 (753B MoE) quantized to Int4-Int8Mix + NVFP4 4-bit KV cache, TP=4 across 4× DGX Spark (GB10) at 100K context, run on Terminal-Bench 2.1…

r/LocalLLaMA Communities

I was tired of agent frameworks burning tokens on polling loops, so I built a reactive node network that runs entirely on local models

Solo side project I've been hacking on for months, finally sharing it. (btw an example of what you can do on the demo video ^^, more…

r/LocalLLaMA Communities

Complete local model asset generation pipeline

So I figured I'd update the community given I just shipped a nice little feature set and feel like sharing it finally :) In the past…