r/LocalLLaMA
· Communities
Need recommendations for small models with excellent reasoning. Professionals opinions preferred, this is for a data pipeline not chat.
I'm distilling from Gemini Pro 3.1 as the teacher, the task has a mixture of data extraction and analysis. I need to process about 90 million texts through this pipeline and keep hallucinations below 10%. I have an excellent fine-tuning dataset which has been cleaned of all bad examples. I'm looking for the smallest mo