r/LocalLLaMA
· Communities
How to distill my own models?
I've been using cloud provided models for agentic theorem proving a lot, and cost is becoming an issue for me. I have funding for hardware cost but I can't use them for LLM credits which put me in a unique situation where it might be cheaper to self-host models instead of paying cloud models. The problem is that theore