LessWrong AI
· Communities
How To Catch a Distilled Model
"Distillation is great until your new trillion-dollar sovereign AI introduces itself as 'Claude from Anthropic' on day one."- random guy from RedditTLDRWe introduce a novel algorithm to detect distillation across large language models.We provide evidence suggesting this approach can be applied to logit-based and hard-l