r/LocalLLaMA
· Communities
Ling-3.0-flash quant ladder on one DGX Spark: the whole thing sits in a 32 to 40 tok/s band
The interesting part of this one isn't the top number, it's how little distance there is between the top and the bottom of the ladder. Where it comes from: I work on Ling at inclusionAI, these aren't my numbers. sudoingX on X benched the full community GGUF ladder on his own DGX Spark, posting his results with permissi