r/LocalLLaMA
· Communities
Memory Bandwidth problems with Intel Sapphire Rapids
I have a Xeon w7-3465 and 4 sticks of RDIMM DDR5-4800 with a theoretical max bandwidth of 153GB/s. I am trying to run DeepSeek-V4-Flash-0731 as it is an MoE and the weights are in MXFP4, so I should roughly process 150GB/6.5GB tokens per second as it has 13B Experts. The problem is, I've only seen around 36-40GB/s max