Laguna S 2.1 Thinking mode
If many people have noticed that there's no reasoning phase in Laguna S 2.1. I noticed the Poolside development team updated the chat template twice in…
Latest
Laguna S 2.1 looping fix incoming
Poolside have updated the full precision, and FP8 versions with a fix for the looping issue many of us have been seeing. Other variants incoming. Discussion…
BTL-3 27B agentic coding and tool-use model from Bad Theory Labs (fits in 8.39GB)
https://x.com/Badtheorylabs/status/2079306502897074249 A 27B open-weight agent model built for agentic coding, structural tool use . The complete thing fits in one 8.39GB file under 2.5 bits per…
Genesis-Science-1 (GS1), 1T open-weight model later this year from Arcee AI
Today the Department of Energy (DOE) and Arcee AI announced the development of Genesis-Science-1 (GS1), an open model for scientific research. This is a joint effort…
Built a from-scratch BitNet inference engine in pure C — 1.8× faster than bitnet.cpp on Xeon (36 tok/s), zero dependencies [BitNet & Bonsai CPU testers wanted]
Hey r/LocalLLM, Built Project Zero — a from-scratch CPU-only LLM inference engine in pure C99. It beats bitnet.cpp by 1.8× on the same hardware. We also…
Mage-Flow – An Efficient Native-Resolution Foundation Model for Image Generation and Editing – Microsoft
Models: (Check Model cards for so much sample demo images) https://huggingface.co/microsoft/Mage-Flow https://huggingface.co/microsoft/Mage-Flow-Turbo https://huggingface.co/microsoft/Mage-Flow-Edit Mage-Flow is a compact 4B-scale generative stack for efficient text-to-image generation and instruction-based…
microsoft/Fara1.5-27B · Hugging Face
Fara1.5-27B is a multimodal computer use agent (CUA) for web browsers, from Microsoft Research AI Frontiers. It observes the browser through screenshots and acts on the…
Cactus Hybrid: We taught Gemma 4 to know when it’s wrong
Hey HN, Henry & Roman here from Cactus. A small, on-device model is fast and private, but sometimes wrong, but frontier models are getting expensive pretty…
Dear Michael, LLMs don’t run on proprietary technology, but they do run on lots of proprietary data aka stolen IP
submitted by /u/ZenaMeTepe [link] [comments]
16x AMD MI50 32GB: GLM-5.2 Q4 at 12.2 tok/s with llama.cpp RPC
GLM-5.2 UD-Q4_K_XL GGUF @ 12.2 tok/s output // 30.9 tok/s input on a real 10.7k-token document using llama.cpp RPC - At 10.7k context: 10.2 tok/s output…