X · @hardmaru
· X / Twitter
Running K3 locally on m5 max at 0.3 tok/s This is probably as slow as it will ever be😅
Running K3 locally on m5 max at 0.3 tok/sThis is probably as slow as it will ever be😅antirez: That's a bit slow. Streaming directly the K3 official hugging face 1.6TB of weights in mxfp4 in an m5 max 128gb.