r/LocalLLaMA
· Communities
What small models have you guys been using?
I’ve been seeing a lot of people talking about small models (~7B), and I discovered them when I started running models locally on my MacBook Air M1 (8GB). I’ve realized that 99% of the time, we don't actually need massive 1.3T models like Kimi k3, nor do we need to pay a ton of dollars for a Claude subscription. We jus