Leaks : Z.ai GLM5.5 aiming Fable-5 on August
submitted by /u/Informal-Trouble2183 [link] [comments]
Latest
model: add NextN/MTP speculative decoding support for GLM_DSA (GLM-5.2)- #25980 MERGED!
https://preview.redd.it/0hyejovsw5gh1.png?width=2091&format=png&auto=webp&s=102dbd7b2b8a76b7769e05fc04c79140e16aa118 model: add NextN/MTP speculative decoding support for GLM_DSA (GLM-5.2) by satindergrewal · Pull Request #25980 · ggml-org/llama.cpp submitted by /u/YPSONDESIGN [link] [comments]
Microsoft did it …. again! (404 for their Mage-Flow models on HF)
Still you could grab GGUF, MLX, FP8, etc., from others on HuggingFace. https://huggingface.co/models?sort=trending&search=Mage-Flow GitHub : https://github.com/microsoft/Mage Take backup of GitHub ASAP. Thanks for your comment u/Mk-Daniel…
I built a GBNF grammar compiler that makes 8B models reliably call tools – here’s how it works (deep dive)
I've been building a local agent in Rust (Eris) that runs on llama.cpp and uses an Obsidian-compatible vault as memory. ~50 tools (vault read/write, memory, reminders,…
Is Laguna s2.1 fixed?
Laguna s2.1 launched about a week ago, the benchmark's that they advertised were crazy good. But It was a mess, looping issues, tool ussage problems, not…
Built and released BetterGPT-150M – A compact 150M parameter completion model (+ live HF Space demo)
Hey everyone, I recently finished pre-training BetterGPT-150M, a small, lightweight causal language model with ~152 million parameters.Trained on 15B tokens. Dataset & Training: Trained across stable…
In-house LLM Inference on Kubernetes: A Production Runbook
Wrote this as I built the infra at my org. Let me know what you all think... https://gd03.me/writings/inference-infra submitted by /u/GD-Champ [link] [comments]
dropped 4k on a spark, am I crazy?
Saw that the Asus Ascent 1tb was going for $3,950 from a few sources, couldn't stop thinking about it, finally just went ahead and did it.…
Anyone tried the Q1 Kimi K3 yet? (555GB)
submitted by /u/Hannibalj2ca [link] [comments]
A.X-K2 released
https://huggingface.co/skt/A.X-K2 https://huggingface.co/skt/A.X-K2-ALM https://huggingface.co/KRAFTON/A.X-K2-Raon-Speech-21B-A3B 688B-A33B + About South Korea's Soverign AI Foundation Model Project. South Korea's Soverign AI Foundation Model Project (This will not be official English…