What’s your favorite underrated local model?
What’s your favorite underrated local model that you actually use every day? I’m not talking about the mainstream choices like Qwen 3.6 or Gemma 4. I’m…
Latest
I tried fine-tuning a ternary model, Bonsai 8b, on metal
We've heard the hype around binary and ternary models, and it seems recently, their performance is starting to catch up and be competitive for every-day use…
I made a very detailed guide on how to run Qwen 27B through GHCP harness at highest performance and best quality
https://www.reddit.com/r/LocalAIStack/s/ptJzZPKcy0 The guide is based on hundreds of hours of testing, actual usage on corporate partially air-gapped environments. The best settings for high performance, high quality,…
Qwen vs Gemma
Hi! Been doing some local LLM stuff, and I can't help but notice: despite vastly-superior benchmark scores, Qwen 3.6 35a3B feels... substantially less intelligent than Gemma…
Inkling?
Has anyone gotten inkling working with llama cpp with cpu and ram only? If so can you share the launch script & other details? submitted by…
head of strategic futures from openai on open-weight chinese models.
Dean W. Ball analyzes China's Kimi model, noting its strong performance while expressing surprise that the Chinese government permits open-sourcing such capable AI due to potential…
German SooFi team launches Soofi S 30B-A3B , an open-source Mixture-of-Experts (MoE) hybrid Mamba–Transformer foundation model for German and English.
submitted by /u/epSos-DE [link] [comments]
FastFlowLM Joins AMD to Advance AI Inference
Super excited to have the FLM team as co-workers! submitted by /u/jfowers_amd [link] [comments]
Sharing MiniBot v2, this is what I’m currently using I gave it a major update so I thought I’d share. I make things that do work for me, always have… and this is the latest.
It a single file 20k lines ;P https://github.com/illsk1lls/MiniBot (i previously posted v1 of this, which was not WPF) This is for local models only. Although it…
CMP 170HX 8gb — Perf + Memory + PCIe Gen2 Unlock – NVIDIA Driver 610.43.03 (patched open kernel modules)
CMP 170HX 8gb — Perf + Memory + PCIe Gen2 Unlock NVIDIA Driver 610.43.03 (patched open kernel modules) GPU: CMP 170HX (0x20C2) Result: 64 GB HBM2e…