X · @natolambert
· X / Twitter
Yo @benthompson I'm sorry but the Chinese labs aren't using Fable / the strongest models as teachers during RL, that's not how distillation works. It …
Yo @benthompson I'm sorry but the Chinese labs aren't using Fable / the strongest models as teachers during RL, that's not how distillation works. It wouldn't give that big of a lift (graders during RL are messy) and you cant afford to use Fable like that.