X · @teortaxesTex
· X / Twitter
Bro, 500 t/s off 8xB300 is… not just "expensive" Small deployment units are suffering It's orders and orders of magnitude
Bro, 500 t/s off 8xB300 is… not just "expensive"Small deployment units are sufferingIt's orders and orders of magnitudeCasper Hansen: you might think "oh this is just marketing"... but that's where you are wrong.spun up a fresh 8xb300 today and getting avg of 541 tokens/s and max of 1104 tokens/s when using it in claud