r/LocalLLaMA
· Communities
Benefits of a second cheap GPU, what capabilities are gained?
Right now I have Gemma 4 26B-A4B (Q4_K_M) running reasonably well (12-15 t/s) on my hardware, which is an i5-8500, 48 GB of DDR4, and an RTX 3060 (12 GB)—PCIe is Gen 3. However, it's just not very smart. It's good at paraphrasing everything I say, which helps if I'm trying to make sure I've covered every aspect of a to