X · @rasbt
· X / Twitter
The MiniMax M2 series was one of the most widely used open-weight LLM series earlier this year. Now, we got a technical report with some interesting t…
The MiniMax M2 series was one of the most widely used open-weight LLM series earlier this year. Now, we got a technical report with some interesting tidbits. I summarized some of them below:1. Full attention as an anti-trend?:They tried hybrid sliding-window attention variants (like so many others, like Xiaomi MiMo, La