Disclosure: I’m the author of Ante. DeepSeek recently reported an 82.7% score on Terminal-Bench 2.1 for DeepSeek V4 Flash 0731. Its evaluation used “DeepSeek Harness minimal…
What Local Embedding + Reranking Models are you guys running for RAG? I went down this rabbit hole because I wanted a Embedding Model + Reranker…
Howdy - I posted a benchmark here - https://www.reddit.com/r/LocalLLaMA/comments/1vbtiy7/deepseek_v4_flash_on_slopcodebench/ This was using the hosted API - since then I've been playing around with quants Here is…
Would it be possible and make sense to add metadata to training data e.g. a trustfactor (0.0 - 1.0)? For example: the older data is the…
I’m reaching speeds of 260T/s tg and 20k pp on my 3090s lol, because this model is small and meant to run on phones. From what…
I have a Xeon w7-3465 and 4 sticks of RDIMM DDR5-4800 with a theoretical max bandwidth of 153GB/s. I am trying to run DeepSeek-V4-Flash-0731 as it…
Geometric reasoning sounds like the cure all snake oil was. But what do I know? Thoughts? submitted by /u/silenceimpaired [link] [comments]
as a programming ignoramus this kind of thing seems extremely impressive to me... maybe others can shed light on whether this is expected from this level…
submitted by /u/panchovix [link] [comments]
Intel's Optane technology as we know it has been discontinued. But while that's the case, I see it being highly promising still due to its role…