X · @cwolferesearch
· X / Twitter
Recently did some deep reading on continual pretraining (CPT) to better understand best practices for creating domain-specialized open LLMs. Here are …
Recently did some deep reading on continual pretraining (CPT) to better understand best practices for creating domain-specialized open LLMs. Here are the best practical resources / model reports that I found on the topic:- CPT best practices (Databricks): https://www.databricks.com/blog/characterizing-datasets-and-buil