r/LocalLLaMA
· Communities
DeepSeek V4 Flash 0731 – Happy Numbers (700pp/18tg) and Thoughts
Originally, I was only getting around 140pp/s and about 21tg/s, but the config with -b 8192 -ub 8192 --cpu-moe is vastly superior, let's say 700pp/s and 18tg/s in the most relevant range. Test System: CPU: Threadripper 5965WX (24c/48t) RAM: 512GB (8x64 DDR4 ECC REG 2400) GPU: RTX 5090 (PCIe 4 x16, 450W) Command ./build