New DeepSeek V4 Flash 0731 vs ChatGPT Luna comparison
submitted by /u/perelmanych [link] [comments]
Latest
Deepseek V4 Flash 0731. LM Studio loading only into RAM.
The model refuses to load into VRAM and uses only RAM. What can be an issue? Q2_K_XL from Unsloth if that changes something. submitted by /u/esw123…
DeepSeek-V4-Flash-0731: Models you can run locally now have the intelligence score of the top frontier model from March 2026
March 6th, 2026 the highest intelligence index score was 51 for frontier models. deepseek-ai/DeepSeek-V4-Flash-0731 that has an intelligence score of 50. If these benchmarks are accurate,…
Are 1B LLMs Going Away in 2026?
I don't know much about llms aside from downloading them through a frontend and running them on my laptop or potato phone. Google released gemma 4,…
Weight-Aware Streaming Tensor Engine: run Kimi K3 using 29 GB of RAM at 0.50 tok/s
submitted by /u/galapag0 [link] [comments]
Qwen 3.6 27B Q5 on 3x2080ti: 55tps with llama.cpp. Can I squeeze out more?
CPU: Threadripper 3970X RAM: 128GB DDR4 GPUs: 3x2080ti 11GB The current best parameters to run it: llama-server --model Qwen3.6-27B-Q5_K_S.gguf --n-gpu-layers 999 --split-mode tensor --flash-attn on --cache-type-k…
OAI just panic-slashed GPT-5.6 Luna prices by 90% lmao. DS4F is breaking the market.
https://openai.com/index/advancing-the-price-performance-frontier-with-gpt-5-6/ Even after the 90% cut, Luna is STILL about 3.3x more expensive than DS4F for the same intelligence bracket. From the chart, the obvious next…
A q2_k_s walks into a bar and
sat on a mat. submitted by /u/Risen_from_ash [link] [comments]
What is the point of the funny tag in this sub if you can’t even post a damn meme????
I'm constantly bombarded by non-local LLMs in this sub but god forbid I post a local model meme. submitted by /u/fragment_me [link] [comments]
What speeds are everyone getting with deepseek v4 flash 0731?
What speeds are everyone getting with deepseek v4 flash 0731? I’m getting~200 tps prompt processing / ~11 tps token gen, on 4x5060ti16gb with ddr4 3200 ram…