r/LocalLLaMA
· Communities
Are you ready for Le Chaton FAT or still wasting money on GPUs?
According to rumors (spread by myself) Le Chaton FAT will be 26T-a3b and I AM READY for it. Let's be real, I can't afford that many 5060Ti, so I got 12x Gen 4 3.2 TB (two per card). This gives me about 60GBs bandwidth on 30TB. Added 256gb ddr4 just for kv cache, but I can also write KV-cache to the disks, these are hig