DeepSeek-V4-Flash-0731 UD-IQ3_S 12.5 tok/s on RTX 3090 +128GB DDR5
I managed to run DeepSeek-V4-Flash-0731 UD-IQ3_S in text-generation-webui with: RTX 3090 24 GB 128 GB DDR5 overclocked to 5600 MHz using AMD EXPO llama.cpp loader First,…
Latest
A collection of small domain-specific benchmarks for local models (30+ and growing)
Hello fellow local AI people! I took "you must create your own benchmarks" literally, and built a website for this. How does the end result look…
What’s next for Qwen open-source releases?
Been using Qwen 3.6 35B-A3B quite extensively lately and honestly, I’m pretty happy with it. Also tried a few community improvements like Ornith 1.0, which add…
Is there a point where models just cannot get any smaller without losing intelligence?
DeepSeek V4 Flash got me thinking... We keep seeing smaller models get way better. A model at a certain parameter count today can be much smarter…
Fix for Deep Seek v4 Flash 0731 tool calling has been added to llama cpp
This pull request was added to the main llama cpp about 12 hours ago. I was experiencing some looping and poor behavior yesterday but haven't had…
Safety and reliability of a dual PSU config
I'm building a render monster for work, and the idea is to stuff as much GPU power in there as possible. GPUs are going to be…
I’ve had ling-3.0-flash and glm-5.2 both in my executor slot for a few weeks. They don’t split the way the benchmarks predict
Same harness, same task set, same agent scaffold, the only thing I swapped was the executor. Not a proper benchmark, no clean tok/s numbers, this is…
Deepseek v4 flash 0731 still not holding up.
The biggest issue with preview was its inability to follow rules prompts and skills. It seems like no matter what you do it ignores them. I've…
DeepSeek-V4-Flash-0731-UD-Q3_K_XL 3×3090 test results
For anyone interested, here are the llama-bench results on 3 bit K_XL quantization. I think this could be pushed further but no luck so far. Command…
Anyone else feeling this way about the closed frontier?
https://preview.redd.it/u3xo0qklksgh1.png?width=680&format=png&auto=webp&s=9d72c80bbad2559e210897e137d30c88faa7bbc7 Hehe. submitted by /u/laterbreh [link] [comments]