Just caught up with the recent GLM-5.2 release. The best open-weight model today.Architecture-wise, it's build on the GLM-5 and GLM-5.1 architecture that I covered previously, which…
Crazy model! It actually uses the old Qwen2.5-Coder-3B stack and got really great performance with their post-training stack. Need to use it in the next days…
Cool new open-weight model by Cohere: a new lightweight 30B open-weight model for agentic coding tasks.This one builds on Command A+ using the parallel transformer design.…
Turns out Fable 5 is shadowbanning AI researchers 🫤elie: mythos will be bad ON PURPOSE on ai "frontier llm research" tasks, this is very very sad…
Always back to the basics: LatentMoE was probably inspired by MLA, which was inspired by LoRA, which was inspired by SVD, which was inspired by eigendecomposition.
And another open-weight release. Nemotron 3 Ultra has an ultra impressive capability:efficiency ratio! Design-wise, it carries forward the Mamba-2-attention hybrid stack and LatentMoE introduced in the…
It's been a while! 4 nice additions to the open-weight local-LLM-on-consumer-hardware ecosystem:
The MiniMax M2 series was one of the most widely used open-weight LLM series earlier this year. Now, we got a technical report with some interesting…
Added a DeepSeek Sparse Attention (DSA) from-scratch implementation to my LLMs-from-scratch repo thanks to an awesome new reader contrib. With motivation, overview, and GPT-style model reference…
It's been *almost* a bit quiet around LLM architecture releases in the past two weeks 😅Interesting tidbit is the parallel block design. Via the Cmd-A the…
X · @rasbt is one of 172 primary AI sources we aggregate. 14 stories from this source have been indexed. Domain: x.com. All posts here link straight to the original — we don't republish content, we point readers at it.
See the full source catalogue or browse by model.