r/LocalLLaMA
· Communities
My reasons to run local models
I can finetune any model on any dataset I want. I can use techniques like speculative decoding and other sota approaches to get the max tps The llm provides like anthropic and openai are not getting access to my data The hardware is reusable for vision text speech, and I can run any blend of models for free as much as