r/LocalLLaMA
· Communities
DeepSeek-v4-Flash-Mini 54GB GGUF running at ~20.5 t/s
Took the REAP adaptation of DeepSeek-V4-Flash (0xSero/DeepSeek-V4-Flash-0731-REAP) along with antirez/deepseek-v4-gguf as inspiration, and decided to see how aggressive we could get with standard quant tricks to create a budget-friendly "Mini" build. For the lulz, naturally. Started with the full 95GB bf16 GGUF and cru