r/LocalLLaMA
· Communities
Update: First Manual Results from Testing Procedural Skill Transfer in Small Models
Yesterday I posted an idea for testing whether a large model can transfer some of its procedural skill to a smaller model without fine-tuning. The short version of the idea was this: Small models are often not completely lacking knowledge. They know the syntax. They know the libraries. They usually understand the task