Skip to content
r/LocalLLaMA · Communities

P40’s + MI50’s + RPC on 550B Nemotron Ultra Q3_S

Hey guys, I went ahead and installed a 100Gbe NIC card on both my MI50 machine and my P40 machine and loaded Nemotron Ultra IQ3_S across both machines. I was pretty surprised on the throughput for such old hardware. Given the results - I now have my sights on purchasing the Chinese 22GB RTX 2080 Ti's to append more VRA