r/LocalLLaMA
· Communities
Looking for inference compute integration ideas – standard consumer 5090 PC, TB4/5 5090 eGPU, M3U 256gb Studio, & 14th Gen Dell Server
Before you roast me too hard, this is a hobby and all of this is just for fun. Would my stack be much more efficient and efficacious if I sold everything and built a dual Pro 6000 system on a threadripper mobo and threw in a large JBOD? Without a doubt in my mind. But that's a lot of work so I'm making this post in cop