Auto-fit vs tuned MoE offload: 564 → 1330 pp tok/s, unchanged decode (Qwen3.6-35B-A3B Q6 / RTX 3090)
TL;DR: On a Qwen3.6-35B-A3B Q6 setup sized for 64K context on a 24GB RTX 3090, spilling eight MoE expert layers to CPU freed enough VRAM to…
Communities 6693 stories
Show HN: Skyline Co-op is like SimTower, but built around democratic socialism
I've been rebuilding old games with Claude. While creating a modern take on SimTower and having election news on TV in the background, I had the…
Final optimization: from ~10 tok/s to ~15 tok/s on DeepSeek-V4-Flash-0731 at 128K ctx – 1 RTX 3090
J'ai consacré beaucoup de temps à l'optimisation de DeepSeek-V4-Flash-0731 GGUF sur une seule RTX 3090. Mon exigence absolue pour chaque configuration était la suivante : Le…
Show HN: demake – one source project compiles to any retro game console ROM
This started life as a graphics tool for a specific problem: gen AI can make retro-styled sprites but can't follow exact hardware constraints of pixels and…
How Americans View Capitalism, Socialism and Free Enterprise
Article URL: https://news.gallup.com/poll/713144/americans-view-capitalism-socialism-free-enterprise.aspx Comments URL: https://news.ycombinator.com/item?id=49195244 Points: 11 # Comments: 4
Mario Meets Pareto
Article URL: https://www.mayerowitz.io/blog/mario-meets-pareto Comments URL: https://news.ycombinator.com/item?id=49195231 Points: 28 # Comments: 3
Matryoshka NLAs: training activation verbalizers to frontload reconstruction-relevant information
TLDR: We train a “matryoshka” NLA that, unlike standard NLAs, is trained to put the most important details at the start; it is trained by randomly…
Why You Should Almost Never Use AI to Write Anything Substantive
I think you should almost never use AI to write -- that is, to do the thing you're doing when you type words on a page…
Best llama cpp flags to run Deepseek-flash 0731
Hi all. These are my system specs: dual xeon e5 2696 v2 , 160gb DDR3 ram ECC(1600mhz), 3 gpus: 3060 12gb, p100 16gb, 3050 6gb. And…
Don’t forget to train and use your brain. Literally.
This is a screenshot from a recent Theo.gg video (Apple rant; tldr: he is realizing the lockdownness after...years.) and the fact he asked ChatGPT for an…
Reward is hyperstitional information
(This article broadly explains mirror ascent, continuous Bayesian inference and information geometry in full. Title refers to the result in section 3.) The logarithmic scoring rule…
What I love about Django
Article URL: https://buttondown.com/blog/what-i-love-about-django Comments URL: https://news.ycombinator.com/item?id=49193673 Points: 5 # Comments: 0
The Passive Man
It's not that I meant to watch Youtube Shorts all day. What I meant to do was watch one of the long-form videos from my favorite…
i just spent weeks rewriting my webUI from scratch, getting rid of all AI slop within the codebase and switching it over to a proper lightweight framework (alpine.js). i am now comfortable suggesting it as an alternative to openwebUI, librechat and the like! it is made for local models
[Fully open source under GPL3, made from the ground up for use with local models, no subscriptions, no corporate backing] When i first started this, it…
Qwen3.8-2.4T-A95B (aka Qwen3.8-Max) open release time: next wednesday
https://preview.redd.it/9zwlpcushphh1.png?width=972&format=png&auto=webp&s=18cb49c738caba9799d22d4916337c772baa830f https://modelscope.cn/models/Qwen/Qwen3.8-2.4T-A95B submitted by /u/HugeConsideration211 [link] [comments]
I get that AI labs need to make money, but zero-warning price spikes are a nightmare for production builds
Seen a ton of posts today about the DeepSeek API price hike. Half the feed is doom-posting, the other half is explaining basic GPU economics. Honestly,…
[R], Need some best model suggestions for Face Detection,Face Recognition,Body Detection and Body identification. [R]
need those for analysing movies. example let's say I have to find the screentime of the actor over the whole runtime of the movie and…
ByteDance is leaning heavily into AI education with Gauth — helpful tutoring or just another shortcut machine? [D]
Saw an article about ByteDance scaling up Gauth using AI-generated animations to walk students through problem-solving. On paper, personalized visual explanations sound great for democratizing tutoring.…
Let's all meet up in the Y2K
Article URL: https://blog.gingerbeardman.com/2026/08/06/lets-all-meet-up-in-the-y2k/ Comments URL: https://news.ycombinator.com/item?id=49193314 Points: 9 # Comments: 1
What are the biggest challenges in collecting high-quality speech and egocentric video datasets? [D]
We're currently involved in collecting two types of datasets that seem to be increasingly important for multimodal AI Studio quality speech/audio datasets (high fidelity recordings) Egocentric…
On non-rooted Android 17, ADB uninstall of system apps fails
Article URL: https://github.com/Universal-Debloater-Alliance/universal-android-debloater-next-generation/issues/1426 Comments URL: https://news.ycombinator.com/item?id=49193173 Points: 9 # Comments: 1
Crime Pays but Botany Doesn't
Article URL: https://www.crimepaysbutbotanydoesnt.com/reading-list Comments URL: https://news.ycombinator.com/item?id=49192566 Points: 64 # Comments: 11
GLM/Qwen Appreciation Post
https://preview.redd.it/o6ik6qboeohh1.png?width=1134&format=png&auto=webp&s=4016f26c50c1d93bd3d0c7e880e9b55a2d75310f I have been running Qwen3.6 27b for a little while (mostly coding tasks) and recently trying out V4 flash 0731 in it's place. It was…
Ship Safe, an open source security scanner for coding agents
Article URL: https://github.com/asamassekou10/ship-safe Comments URL: https://news.ycombinator.com/item?id=49192277 Points: 3 # Comments: 0