r/LocalLLaMA
· Communities
Framework Pro 13 for running smaller models of MoE
Does anyone have any solid idea regarding the performance for running models like Qwen 9B / 14B or similar Gemma models? Same for MoE models. A search tells me it should be running pretty good as long as it's not denser, larger models that fit in ram. I have 256GB of unified ram* but sometimes the power goes out on the