You really should not quantize KV Cache for DeepSeek V4 Flash
I don't think anyone should quantize the KV with DS4F. I checked the the quality impact (PPL, KLD, Same TopP) for swhitching from BF16 KV to…
DeepSeek V4 @ IQ3XXS on M1 Ultra 128GB- 16 tok/s in LM Studio after patch
M1 Ultra 128GB, Unsloth UD-IQ3_XXS, wired limit at 120GB. I was at 5-6 tok/s before the patch. Getting 15-16 tok/s now with the patched engine, and…
DSpark Benchmark Result on Deepseek v4 Flash 0731
TensorSharp supports DSpark on Deepseek v4 Flash 0731 now. Here is the benchmark result on 4x Nvidia A40 GPUs, cuda 12.8 with/without DSpark: Model: DeepSeek-V4-Flash-0731-UD-Q8_K_XL from…
Deepseek v4 flash – 100-150 faster t/s in prefill/pp.
You have two choices here (in order of pref): Downgrade CUDA from 13.3 to 13.1 (skip 13.2 due to bugs)
llama.cpp just added MTP / DSpark support for DeepSeek V4 Flash
submitted by /u/rmhubbert [link] [comments]
NEW Deepseek V4 Flash : MMLU-Pro , GPQA Diamond and truthfulQA ?
About the new deepseek v4 flash version / update, does anybody now about the new values about: MMLU-Pro GPQA Diamond TruthfulQA About the other values, its…
> After using DeepSeek v4 Flash for a day, its Harness is much better than Kimi K3!!! Intriguing
> After using DeepSeek v4 Flash for a day, its Harness is much better than Kimi K3!!!IntriguingYufan Sheng: 用了一天 DeepSeek v4 Flash，它的 Harness 比 Kimi K3…
There had been no “preview subsidy” SiliconFlow prices are distinct from DeepSeek’s and in particular worse on cache Nevertheless they do work toge…
There had been no “preview subsidy”SiliconFlow prices are distinct from DeepSeek’s and in particular worse on cacheNevertheless they do work together and this is a minor…
DeepSeek V4 Flash 0731 local setup gotcha: model, tool call & config setting
I spent a while debugging my local DeepSeek V4 Flash setup and wanted to share a few lessons from the process in case it saves someone…
Wenfeng is too cultured to really act like this, but he totally feels this way DeepSeek people have a lot of pride in what they do
Wenfeng is too cultured to really act like this, but he totally feels this wayDeepSeek people have a lot of pride in what they doGorden Sun:…
Deepseek v4 flash 0731 still not holding up.
The biggest issue with preview was its inability to follow rules prompts and skills. It seems like no matter what you do it ignores them. I've…
DeepSeek V4 Flash 0731 IQ2_M benchmark for Dual 3060 and 96GB RAM ≈ 3.5 tok/s.
Thanks to the community help I finally launched this llm. LM Studio refused to load weight onto second GPU but Unsloth Studio did so everything was…
New DeepSeek V4 Flash 0731 vs ChatGPT Luna comparison
submitted by /u/perelmanych [link] [comments]
Deepseek V4 Flash 0731. LM Studio loading only into RAM.
The model refuses to load into VRAM and uses only RAM. What can be an issue? Q2_K_XL from Unsloth if that changes something. submitted by /u/esw123…
RT cheaty: help me understand the cope deepseek doomers are going through when they can't even write a tweet on their own why are you making shit up l…
RT cheatyhelp me understand the cope deepseek doomers are going through when they can't even write a tweet on their ownwhy are you making shit up…
the bots are precisely wrong, this is the opposite of DeepSeek's speciality. But come to think of it, DeepSeek is very Tau Law pilled. What they optim…
the bots are precisely wrong, this is the opposite of DeepSeek's speciality. But come to think of it, DeepSeek is very Tau Law pilled. What they…
What speeds are everyone getting with deepseek v4 flash 0731?
What speeds are everyone getting with deepseek v4 flash 0731? I’m getting~200 tps prompt processing / ~11 tps token gen, on 4x5060ti16gb with ddr4 3200 ram…
RT Andrew Ho: The ability for DeepSeek to be price competitive with GPT-5.6 Luna is genuinely incredible. The inference team at OpenAI was brilliant f…
RT Andrew HoThe ability for DeepSeek to be price competitive with GPT-5.6 Luna is genuinely incredible. The inference team at OpenAI was brilliant from what I…
DeepSeek v4 Flash for DS4 (DwarfStar) GGUF w/ DSpark MTP Head
I'm an avid user of Deepseek v4 Flash via antirez's DS4 DwarfStar inference engine, and so when the new checkpoint dropped, the first thing I did…
DeepSeek Upgrades DeepSeek-V4-Flash-0731 with Major Agentic and Coding Gains
DeepSeek published DeepSeek-V4-Flash-0731 on Hugging Face and moved the official V4-Flash API into public beta on July 31, 2026. The model card is explicit that this…
Deepseek V4 Flash is now ~#2 open weight model to Kimi K3 and >50x cheaper
https://preview.redd.it/h7zv5tb3tmgh1.png?width=2854&format=png&auto=webp&s=507380e8f862c18f10f7c5c84da9e8d1c59139b0 Deepseek's new flash model is unexpectedly cheap and high-performing across useful benchmarks. It's priced at $0.09 / $0.18 per 1M. Truly "intelligence too cheap to…
Translation: We had to cut our price by 80% because a open waits model with 284B and 13B active parameter called DeepSeek v4 flash just price/performance mocked us again.
submitted by /u/InternationalGap3698 [link] [comments]
With release of Deepseek V4 I wanted see how the model sizes are trending over time. The trend is that by this time next year, we probably will have Opus 4.5 level models on consumer grade laptops!
I was surprised to see that Deepseek V4 Flash is extremely smart and small enough to fit in setup that can be built with < $50,000.…
Initial testing of DeepSeek v4 Flash shows significant improvements in UI/UX design capabilities (despite being token hungry)
submitted by /u/curiousily_ [link] [comments]