What happened to Petals (Decentralized Inference) by BigScience?
https://www.reddit.com/r/LocalLLaMA/s/3DAhg3HPIa submitted by /u/-OpenSourcer [link] [comments]
Latest
DeepSeek V4, PR merged into llama.cpp !
The PR : https://github.com/ggml-org/llama.cpp/pull/24162 All to git pull, cmake , and download GGUFs ! A vos marques, prêt, partez ! submitted by /u/Squik67 [link] [comments]
Qwen3-tts.cpp + Compose Desktop GUI
I improved my qwen3-tts.cpp implementation to be about 5x realtime on my RTX 5080. It is GGML based, so it should compile and run anywhere -…
Amodei: "Open Source Models Will Eat Your Children"
submitted by /u/johnnyApplePRNG [link] [comments]
What’s the full local AI "doomsday prepper" kit for cold storage? 16-bit safetensors of LLMs (obv), copies/source codes of Llama.cpp, ComfyUI, vLLM, Kobold, LMStudio, etc, macOS, Linux OSes, Windows 10&11, etc, Rufus (including older ones), various VMs, P-E-W’s Heretic/Grimoire, and what else?
For those who want to be as paranoid and maximally doomsday prepped as possible, I am curious what the most thorough "doomsday kit" is of things…
Anthropic’s Amodei: "Open Source models [could take us to] a very dangerous place."
submitted by /u/johnnyApplePRNG [link] [comments]
Samsung, SK hynix, Micron Sued in US Over Memory Price Fixing
submitted by /u/johnnyApplePRNG [link] [comments]
Kind of unexpected: HuiHui abliterated winning over vanilla 3.6-35B-a3b on math and code.
Identical custom quantization recipe on HuiHui's and Vanilla 3.6-35B-a3B. Somehow removing refusal get's you closer to truth and wisdom (?) in math and coding. Benchmarks on…
Effect of GLM 5.2 !!
All hail Z. Ai submitted by /u/Independent-Wind4462 [link] [comments]
Going from single GPU to dual GPU is nice but not in the way I expected
I was expecting what when doubling my VRAM from 24gb to 2x24gb I'd use higher quants with more context, and thus get smarter LLMs, but that's…