X · @huggingface
· X / Twitter
RT Lysandre: AMD just put more memory on one GPU than 5 H100s combined. The new MI455X has 432GB of HBM4. Put 4 in one server and you get 1.7TB. That'…
RT LysandreAMD just put more memory on one GPU than 5 H100s combined.The new MI455X has 432GB of HBM4.Put 4 in one server and you get 1.7TB. That's enough memory to hold the FP8 weights of a trillion-parameter model like Kimi K2 (K3?? 👀) in a single machine.We got early access, and Transformers is already nearly fully