r/LocalLLaMA
· Communities
Glimmer: 233.4 tps on 5090 with Dflash
That's insane yo! I haven't had a chance yet to test it on my 4090 at home but it sounds so promising. And read here that 256k CTX is easily reachable on 24gb unlike Qwen. Super excited! submitted by /u/YetAnotherAnonymoose [link] [comments]