r/LocalLLaMA
· Communities
12GB VRAM gang, what’s our plan?
Seems like we're limited to qwen finetuned MoEs for now. Looking at the current landscape - focus seems to be on dense models (muse glimmer 30b, qwen 3.8 27b) for smaller setups. Is upgrading to 24GB VRAM the only option? submitted by /u/Mean-Ad1493 [link] [comments]