Been building this for a few months. It's called Primnox. The core thing: before ANY message leaves your machine, a local DeBERTa NER model runs on-device,…
Polymarket acquired Craft Agents talent, so I’m bit more wary about heavily investing in it (personal assistant, not coding). it’s my favorite so far, MCP setup…
recently I wrote a blog post, to find which search tool will be best for the pi coding agent paired with local models (currently I use…
Curious if it’s a viable small scale distributed system. submitted by /u/TheSmashingChamp [link] [comments]
I'm trying to round out my quiver of daily driver models for my personal harness. Right now I drive qwen3.6 27b for balanced code and gemma4…
I’m the author of audio.cpp, a C++/ggml runtime for local audio models. I just added VibeVoice 1.5B support and wanted to share the benchmark because long-form…
submitted by /u/jfowers_amd [link] [comments]
submitted by /u/johnnyApplePRNG [link] [comments]
Bartowski's DeepSeek-V4-Flash-MXFP4 GGUF, llama.cpp build 9851 (0eca4d490), deepseek4 arch. Ran the same n_ctx = 10240, same n_ubatch = n_batch = 8192, flash attention on — only…
Hey folks. I know that vibe coding is frowned upon pretty solidly here, and I get that, but I’m not a programmer. I just don’t realistically…