X · @teortaxesTex
· X / Twitter
If Qwens are trained on *trillions* of reasonably diverse and non-inane Opus grade tokens, this is either utterly damning for Alibaba or for the whole…
If Qwens are trained on *trillions* of reasonably diverse and non-inane Opus grade tokens, this is either utterly damning for Alibaba or for the whole synthetic data cottage industry. It smells nothing like Opus, and I mean that in a bad way.wh: 28.8 million traces of length 1 million is ~30T tokens. Qwen 3 was pretrai