Qwen3.6 35B A3B KV cavhe quantizations memory footprint
Is it really worth it to quantize KV cache below Q8 accepting heavy trade-off submitted by /u/token---- [link] [comments]
Communities 7150 stories
Learning Musical Multitasking
I like to play multiple instruments at once, and really enjoy how this lets me create a fuller musical picture. Sometimes this looks like mandolin +…
Demis Hassabis on the New Coming Age
Google CEO Demis Hassabis offered us a first rate second rate essay, A Framework for Frontier AI and the Dawning of a New Age. I’ll go…
It could have been Meta
Imma write some fan fiction for a second here if you indulge me. What we are seeing from the Chinese open models could have been Meta.…
Clever hacker fits 537,000 domains in a $5 ESP32 ad-blocking dongle
Article URL: https://www.tomshardware.com/networking/clever-hacker-fits-537-000-domains-in-a-tiny-usd5-esp32-ad-blocking-dongle-firmware-uses-only-around-50kb-of-ram-and-can-answer-blocked-lookups-in-10-milliseconds Comments URL: https://news.ycombinator.com/item?id=48968348 Points: 19 # Comments: 6
Bananas sprout in Rayleigh Garden UK after 15 years
Article URL: https://www.bbc.com/news/articles/cvg8edqq5g5o Comments URL: https://news.ycombinator.com/item?id=48968063 Points: 11 # Comments: 5
Save the date: Swiss AI Safety Days 2026 (7-8 November, ETH Zurich)
Swiss AI Safety Days 2026 is the next chapter of the Zurich AI Safety Day. Last year, our inaugural 2025 event was named Best Event in…
How do we benefits from 2+ T models?
Hey, I’ve been really excited to see the latest models being released, but I keep wondering: what are we actually supposed to do with them? I…
Follow up: GPT-2’s vocabulary as a hyperbolic tree — 32,070 tokens in a Poincaré ball you can fly through [P]
GPT-2's vocabulary as a hyperbolic tree: 32,070 tokens inside a Poincaré ball that you can explore. Link : https://aethereos.net/static/tinny66666.html Link named after a reddit user disappointed…
Qwen 3.6 27B + Opencode: what am i doing wrong?
Ok i'm sort of getting desperate here. So i am currently running Qwen 3.6 27B locally at Q8_K_XL and with only ~105k CTX at q8_0. Before…
poor man’s way to local inference on the go
Many bring egpu to game on laptop, yet here I am fiddling with llama cpp params for 1-time crappy HW configuration for Qwen3.6 35B A3B. idk…
Ethical consumption needs to be easy to identify, accessible and affordable, especially in a worsening economy. And we need to rethink what we should be optimising our economy for
I don’t know anyone who wants the rainforest, which is storing carbon and biodiversity and undiscovered medicines for us all, to be burned down for their…
Am I focusing on the wrong skills as a CS student in the AI era? (Need brutally honest advice) [D]
I'm a Computer Science student about to start my 4th semester this September in Pakistan. My long-term goals are: - Maintain a high GPA because I…
I burned all my tokens researching how to save tokens
Article URL: https://quesma.com/blog/custom-deep-research-pipeline/ Comments URL: https://news.ycombinator.com/item?id=48967355 Points: 10 # Comments: 4
Minecraft: Java Edition now uses SDL3
Article URL: https://www.minecraft.net/en-us/article/minecraft-26-3-snapshot-4 Comments URL: https://news.ycombinator.com/item?id=48967256 Points: 5 # Comments: 0
OpenAI head of strategic futures says open-weight model dominance is AI communism
submitted by /u/AloneCoffee4538 [link] [comments]
I joined the IndieWeb, here's what I learned
Article URL: https://en.andros.dev/blog/0b8e451e/i-joined-the-indieweb-heres-what-i-learned/ Comments URL: https://news.ycombinator.com/item?id=48966984 Points: 5 # Comments: 1
Show HN: Akashic – A self-hosted intelligence workspace inspired by Palantir
Article URL: https://github.com/CaviraOSS/Akashic Comments URL: https://news.ycombinator.com/item?id=48966939 Points: 9 # Comments: 0
Did someone used Nvidia’s Tensor-RT LLM or other streaming frameworks like DeepSpeed to run full precision models > than the VRAM+RAM?
I wan to do full precision inference with un-quantized, unmodified MoE models like Hy3 on a machine where the VRAM and system RAM together can't hold…
OSS gathering in Shanghai
This seems awesome meetup. Within a day, Qwen started the move with 3.8 version. Hoping for more moves from others soon. Tweet : https://xcancel.com/RenLeanna/status/2078144481812185186#m submitted by…
The death and rebirth of my home server
Article URL: https://sgt.hootr.club/blog/home-server-rebirth/ Comments URL: https://news.ycombinator.com/item?id=48966769 Points: 5 # Comments: 0
Qwen 3.8 Max
Article URL: https://qwen.ai/home Comments URL: https://news.ycombinator.com/item?id=48966754 Points: 23 # Comments: 1
What I learned selling 2,500 MIDI recorders: Hardware is not so hard
Article URL: https://chipweinberger.com/articles/20260719-hardware-is-not-so-hard Comments URL: https://news.ycombinator.com/item?id=48966713 Points: 8 # Comments: 5
Save GPT-5.5
Article URL: https://save-gpt-5-5.fyi/ Comments URL: https://news.ycombinator.com/item?id=48966665 Points: 3 # Comments: 1