X · @teortaxesTex
· X / Twitter
Imagine how hard Anthropic can push their own inference
Imagine how hard Anthropic can push their own inferenceYoussof Al Toukhi: Fable is a monster. 4 hours max thinking goal mode. It got Qwen 3.6 27B at 100+ TPS on a INT8/BF16 hybrid version with INT8 KV cache at 100k context window on 2x 3090s with 8 sessionsThe model is 34GB for reference.@elliotarledge cannot wait to s