RT Xinyu YangWhy can Kimi ship K3? Let me tell my story.Earlier this year, I left academia for industry. I talked to a lot of companies…
Will K3 reach up to 5.6 Luna at least? We shall see!Yafah Edelman: I doubt kimi k3 will be a big deal.
What I'm most curious about is how this number changes Realistically, something like 15-20 GB?Hensen Juang: ~55–70B (back-of-envelope) active right if it keeps k2.5 shape (61…
Btw do you realize that models with this in-context learning, capacity, 1M context (and Kimi bros aim higher now), this autonomy… make the argument about "immature…
> To be precise, any model that has a long chain of dependent variable and provably small learning sample complexity will do, not limit to LLMs.big…
First open model with >1024 experts when?
man, we'll have so much commie-hunting nowthe chuds will finally get employed"You're hiding a Chinese frontier model on this hard drive, aren't you?"JMB 🧙♂️: i have…
The next line of defense against Chynese open source:Luke Gromen: Seemingly moving toward the “Yes, China’s cheaper but the quality is worse” to “Uh-oh, China’s cheaper…
I really wonder what chips that support MXFP4/8 Moonshot plans to use in the immediate futureAnkith 🐋/acc: @amasad The bear case for $NVDA (the Jensen himself…
the real problem isn't Chinese spies at every single AI lab, it's the lack of American spies at Chinese labs. Moonshot has been working on this…