DeepSeek v4 Flash 0731 4bit ~50tps prefill, ~1tps decode on M5 Air 32gb
Currently running some experiments using the streamed experts trick that's been floating around this sub as well as some of my own trickery to get prefill…
Latest
Keyv and friends compromised in active Shai-Hulud supply chain attack
Article URL: https://www.aikido.dev/blog/keyv-and-friends-compromised-in-npm-supply-chain-attack Comments URL: https://news.ycombinator.com/item?id=49166874 Points: 19 # Comments: 0
A question on ICLR and NeurIPS deadlines, and OpenReview [D]
After a very silent discussion period, we are in a very confused state with regards to NeurIPS, and really unsure what to make of everything. We…
U.S. used 'virtually all' of its long-range precision missiles during Iran war
Article URL: https://www.cnbc.com/2026/08/04/us-has-used-virtually-all-of-its-long-range-precision-missiles-report.html Comments URL: https://news.ycombinator.com/item?id=49166860 Points: 10 # Comments: 0
Probably the best way to run DS4 flash on a mac right now (192gb+ vram)
Found this quant, so thought I would share, since its the best I've found so far for running on my mac (m3 ultra). It's got dspark/mtp…
Mini retirements: like a sabbatical, but much smaller
Article URL: https://www.ssp.sh/brain/mini-retirements/ Comments URL: https://news.ycombinator.com/item?id=49166749 Points: 23 # Comments: 38
"Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation", Gladstone et al. 2026 [R]
submitted by /u/Benlus [link] [comments]
Safe Lock-free Primitives with iceoryx2's ByteAtomic
Article URL: https://ekxide.io/blog/byte-wise-atomic-wrapper-to-prevent-ub/ Comments URL: https://news.ycombinator.com/item?id=49166672 Points: 4 # Comments: 1
OpenAI fires back at Apple's trade secret lawsuit with chat logs showing Apple employees kept texting their former colleague
OpenAI is pushing back against Apple's trade secret lawsuit and has released iMessage threads from former Apple engineer Chang Liu. The messages appear to show Apple…
Ray Bradbury's "There Will Come Soft Rains" is set today (2026-08-04)
Article URL: https://short-stories.co/@raybradbury/there-will-come-soft-rains-6k8vr4xxlnmj Comments URL: https://news.ycombinator.com/item?id=49166491 Points: 34 # Comments: 3
Qwen3.8-Max just took #2 in Vision Arena, trailing Claude by only 13 points. Open-source vision is getting crazy close.
submitted by /u/kevin_cn_ai [link] [comments]
Optimised DSv4-Flash for 2x GH200: 10,000 tok/s PP, >300 tok/s TG on SGLang
There are some PRs to use and a nice trick to speed up PP on really longs contexts in my write up. Hope it helps! TL;DR:…
Why Large Language Models Fail at Tabular Prediction
Article URL: https://arxiv.org/abs/2608.02412 Comments URL: https://news.ycombinator.com/item?id=49166442 Points: 8 # Comments: 1
Learning-Rust.Github.io: Rust Programming Language Tutorials for Everyone
Article URL: https://learning-rust.github.io Comments URL: https://news.ycombinator.com/item?id=49166411 Points: 5 # Comments: 1
RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems
Optimizing modern recommender models still depends heavily on engineers manually iterating over architectural, objective, and training-strategy changes. While LLM-based agents can automate this trial-and-error process, allowing…
48 AI-Powered Advertising Campaign Statistics for 2026 That Show What's Changing for Creative Teams
48 AI-Powered Advertising Campaign Statistics for 2026 That Show What's Changing for Creative Teams
DeepSeek V4 Flash on a Single AMD MI300X
Article URL: https://github.com/ryanzhou/deepseek-v4-flash-mi300x Comments URL: https://news.ycombinator.com/item?id=49166386 Points: 29 # Comments: 4
Can Reddit fend off a new wave of AI SEO spam?
Earlier this year, a Reddit user had asked members of a skincare-focused subreddit if anyone had tried a specific hypochlorous acid spray, a product often used…
AI that finally hears you. 👂 Hy ASR 3.0 preview drops today. Powered by Hy3’s language brain → precision ASR + deep semantic understanding Wins o…
AI that finally hears you. 👂Hy ASR 3.0 preview drops today. Powered by Hy3’s language brain → precision ASR + deep semantic understandingWins on:• general recognition•…
"Clean" Code, Horrible Performance
Article URL: https://www.computerenhance.com/p/clean-code-horrible-performance Comments URL: https://news.ycombinator.com/item?id=49166331 Points: 19 # Comments: 2
Homebench – Benchmark local LLMs for speed, memory, and quality
Article URL: https://github.com/david-g-3654/homebench Comments URL: https://news.ycombinator.com/item?id=49166308 Points: 4 # Comments: 0
The US is not a democracy but an oligarchy, study concludes (2014)
Article URL: https://www.upi.com/Top_News/US/2014/04/16/The-US-is-not-a-democracy-but-an-oligarchy-study-concludes/2761397680051/ Comments URL: https://news.ycombinator.com/item?id=49166254 Points: 14 # Comments: 4
An Honest Review of AI Programming
Article URL: https://mropert.github.io/2026/08/04/an_honest_review_of_ai_programming/ Comments URL: https://news.ycombinator.com/item?id=49166230 Points: 12 # Comments: 9
Time to finally migrate from LM Studio -> llama.cpp, your experience?
Has anyone moved from LM Studio to llama.cpp? What was your experience like? What did you have to learn in order to recreate your experience? Which…