r/LocalLLaMA
· Communities
Are EPYC CCDs all you need + benchmarks
Recently I've found a deal to buy 9374f for cheap to replace my bottle-necked 9135. 8 CCD looked delicious. But first benchmarks showed me no decoding advantage. Until I used 48 threads. Non 64 or 32, which gave even worse performance than 9135 in some scenarios. Still not sure it was worth it as 9374f is much worse fo