X · @teortaxesTex
· X / Twitter
> It’s unlikely they could get much of a seed for that via distillation, so it comes down to how strong the base pretrain is and whether it can compo…
> It’s unlikely they could get much of a seed for that via distillation, so it comes down to how strong the base pretrain is and whether it can compose information like Mythos & Sol canNew talking point incoming: Chyna open models are bad on cyber because they can't distill itIbrahim Dagher: A very interesting question