arXiv cs.CL
· Papers
OpenLanguageModel: Readable and Composable Small-Language-Model Pretraining for Education and Research
arXiv:2607.16669v1 Announce Type: new Abstract: OpenLanguageModel (OLM) is an open-source PyTorch library for building and pretraining small language models while keeping their machinery visible. In OLM, model code reads like the architecture: components are ordinary modules, while Block, Residual, Repeat, and Parallel