X · @huggingface
· X / Twitter
RT elie: huge open weight release, motif (korean company) just released a 13B active 314B total MoE performing on par with bigger models like minimax …
RT eliehuge open weight release, motif (korean company) just released a 13B active 314B total MoE performing on par with bigger models like minimax M3 and deepseek v4 Prothey incorporate their own research bets with per expert activation function (polynorm) and a variant of differential attention (they say GDLA, my gue