X · @rasbt
· X / Twitter
The Kimi K3 architecture figure for yesterday's big open-weight model release, along with some observations and thoughts. 1. Yes, it looks relatively …
The Kimi K3 architecture figure for yesterday's big open-weight model release, along with some observations and thoughts.1. Yes, it looks relatively complicated, but it's essentially a scaled-up production version of their Kimi Linear model they released last year (scaled up from 48B -> 2.8T; K3 is by far the biggest o