r/LocalLLaMA
· Communities
GLM 5.2 on consumer hardware
I tried out the unsloth quants of GLM 5.2 on still "consumer-ish" hardware: 32C Zen5 Threadripper Pro 9975 WX, Asus WRX90E-SAGE-SE PCIe Gen5, 512GB DDR5 ECC RAM @ 4800MHz, dual RTX 5090. This machine was put together pre-RAMpocalypse, and by then not exceedingly expensive compared to today's grotesque prices. The quant