r/LocalLLaMA
· Communities
I tested all llama.cpp’s speculative decoding methods on Qwen 3.6 27B: MTP ~2.7x, DFlash ~3.7x, n-gram stack ~6x on real coding. Local AI win. My findings on RTX 6000 PRO.
Hey guys, Last week I posted my DFlash benchmarks here (4.44x at 36K context) https://www.reddit.com/r/LocalLLaMA/comments/1uq0h4o/i_tested_freshly_merged_dflash_in_llamacpp_on/ . One of the comments form u/exact_constraint mention there are also n-gram lookup drafters (ngram-mod, ngram-map-k4v). I find out that they s