r/LocalLLaMA
· Communities
Optimal Realistic Local AI for Most
So you’ve got a 3090 or maybe even a 5090? Or more likely a 4060 8GB Ti. You wanna try local AI, you don’t know what it can/can’t do. 1) Install the best model you can. If you have a 3090 or a 5090, that’s Qwen 27b. If it’s a 4060, it’s Qwen 35b-3a. Search this forum, 35b-3a can RIP on an 8GB card. 2) get an open route