You Could Have Come Up with Kimi Delta Attention
Article URL: https://blog.doubleword.ai/you-could-have-come-up-with-kimi-delta-attention Comments URL: https://news.ycombinator.com/item?id=49085909 Points: 75 # Comments: 10
RT Bhavin Jawade: 𝗞𝗶𝗺𝗶 𝗞𝟯's 𝗽𝗼𝘀𝘁-𝘁𝗿𝗮𝗶𝗻𝗶𝗻𝗴 𝗿𝗲𝗰𝗶𝗽𝗲 Kimi K3's technical report ju…
RT Bhavin Jawade𝗞𝗶𝗺𝗶 𝗞𝟯's 𝗽𝗼𝘀𝘁-𝘁𝗿𝗮𝗶𝗻𝗶𝗻𝗴 𝗿𝗲𝗰𝗶𝗽𝗲Kimi K3's technical report just dropped. K3 is a 2.8T-parameter open-weight MoE model. I went through the report, and here I…
Kimi K3 Architecture Overview and Notes
Article URL: https://sebastianraschka.com/blog/2026/kimi-k3-architecture-notes.html Comments URL: https://news.ycombinator.com/item?id=49085698 Points: 30 # Comments: 0
What is the utility of Blackwells for training V4? It's a cheap model on any possible hardware <4 years old, and 1e25 is just not a big deal. Kimi and…
What is the utility of Blackwells for training V4? It's a cheap model on any possible hardware
It takes a crew to land a moonshot. Join the Kimi Ambassador Program. Anyone who's turned an untested idea into reality knows: moonshots are never a s…
It takes a crew to land a moonshot. Join the Kimi Ambassador Program.Anyone who's turned an untested idea into reality knows: moonshots are never a solo…
The Kimi K3 architecture figure for yesterday's big open-weight model release, along with some observations and thoughts. 1. Yes, it looks relatively …
The Kimi K3 architecture figure for yesterday's big open-weight model release, along with some observations and thoughts.1. Yes, it looks relatively complicated, but it's essentially a…
Confirming the obvious: Kimi K3 has the best kv cache economics out of all major models except DeepSeek V4 (and even then, it’s almost the same ratio…
Confirming the obvious: Kimi K3 has the best kv cache economics out of all major models except DeepSeek V4 (and even then, it’s almost the same…
Kimi Linear: An Expressive, Efficient Attention Architecture
Article URL: https://arxiv.org/abs/2510.26692 Comments URL: https://news.ycombinator.com/item?id=49082022 Points: 4 # Comments: 0
“Only pure bf16 can match Kimi quality” sisters…
“Only pure bf16 can match Kimi quality” sisters…Jennifer's Tech World: @kimmonismus moonshot confirmed during a Reddit AMA today that the released MXFP4 quantization is the exact…
Kimi K3: Open Frontier Intelligence
We introduce Kimi K3, a 2.8T parameter Mixture-of-Experts model with 104 billion activated parameters, native vision capabilities, and a 1-million-token context window. Kimi K3 is built…
When I discussed V4 and K3's philosophies with Fable, it was more impressed by Moonshot's vision. Even more so now. «When something misbehaves, DeepS…
When I discussed V4 and K3's philosophies with Fable, it was more impressed by Moonshot's vision. Even more so now. «When something misbehaves, DeepSeek contains it…
We wrote up a comprehensive guide on using Kimi K3 Read it here 👇
We wrote up a comprehensive guide on using Kimi K3Read it here 👇Zain: http://x.com/i/article/2081553934016299008
A user has managed to run Kimi K3 on 80xRTX 5090, via 25GbE Ethernet.
submitted by /u/panchovix [link] [comments]
Kimi K3 is like an F1 machine inside a show window.
Moonshot dropped Kimi K3, and as expected, it’s a absolute monster. Even with 2~4x RTX 6000 Blackwell local workstations, running a model natively is virtually impossible.…
RT サメQCU: https://x.com/tokenbender/status/2081776672152686883 "kimi stopped using positional embedding" inside the text: "kimi uses a linear attent…
RT サメQCUhttps://x.com/tokenbender/status/2081776672152686883"kimi stopped using positional embedding"inside the text:"kimi uses a linear attention layer which is a positional embedding for other subsequent layers"tokenbender: kimi guys noped the…
Kimi K3 Now Available via Telnyx Inference API
Article URL: https://telnyx.com/release-notes/kimi-k3-telnyx-inference Comments URL: https://news.ycombinator.com/item?id=49076505 Points: 14 # Comments: 5
Another Day 0 partnership. Happy to be part of getting Kimi K3 into Cursor from launch.
Another Day 0 partnership. Happy to be part of getting Kimi K3 into Cursor from launch.Cursor: Kimi K3 is now in Cursor! It scores close to…
Kimi K3 is now in Cursor! It scores close to the frontier on CursorBench. It's available on US-based inference thanks to our partners Fireworks, Toget…
Kimi K3 is now in Cursor! It scores close to the frontier on CursorBench.It's available on US-based inference thanks to our partners Fireworks, Together, and Baseten.…
Kimi K3 is a triumph of scaling maximalism. They scaled the hell out of everything.
Kimi K3 is a triumph of scaling maximalism. They scaled the hell out of everything.
Kimi AI and kvcache-ai Open Sources ‘AgentENV’: A Distributed System that Powers Agentic Reinforcement Learning (RL) Training for Kimi K3
Moonshot AI's Kimi team and kvcache-ai open-sourced AgentENV (AENV) under MIT, as part of Kimi K3 Open Day. It runs agent sandboxes as Firecracker microVMs with…
Damn, Xi Jinping's sleeping pills are something fierce, must be the power of traditional Chinese medicine… according to Fable, Kimi K3 is roughly in …
Damn, Xi Jinping's sleeping pills are something fierce, must be the power of traditional Chinese medicine…according to Fable, Kimi K3 is roughly in the ballpark of…
Moonshot AI releases Kimi K3 open weights and infrastructure after shaking up the frontier model race
Moonshot AI has released Kimi K3's model weights and made parts of its infrastructure open source. The Chinese model nearly matches Western frontier models such as…
Kimi K3 on HF Viewer!
Wanted to let you know that Kimi K3 is now viewable on hfviewer.com! In addition to the full graph at multiple granularity levels, we also include…
Kimi K3 is now available directly from its Hugging Face model page through Together AI, give it a try!
Kimi K3 is now available directly from its Hugging Face model page through Together AI, give it a try!merve: Kimi K3 in @huggingface Inference Providers is…