How i got Bonsai-Ternary-27B to run at 120k context <10gb vram.
Hey guys, so its quite a read, its long. If you are bored just read the TLDR and see if its worth it for you: TLDR;…
Communities 7072 stories
Data centers have hiked electricity prices on the public by $23B
Article URL: https://fortune.com/2026/07/14/data-centers-23-billion-electricity-bills/ Comments URL: https://news.ycombinator.com/item?id=48914683 Points: 36 # Comments: 9
Solving 20 Erdős Problems with 20 Codex Accounts Running in Parallel
Article URL: https://www.starfleetmath.com/ Comments URL: https://news.ycombinator.com/item?id=48914646 Points: 13 # Comments: 2
Vancouver PD website features Quick Escape button that wipes itself from history
Article URL: https://vpd.ca/ Comments URL: https://news.ycombinator.com/item?id=48914644 Points: 6 # Comments: 4
Qwen 3.5 122B Heretic ROCmFP4 iMatrix
My first time doing anything like this, and I built it because I wanted it. If anyone wants the non Heretic I'll mosey that out as…
[audio.cpp] 10 hours of audio generated in 3 minutes on RTX 5090 (demo included)! C++/GGML based Supertonic 3, MOSS-TTS, IndexTTS2, and Irodori-TTS released
audio.cpp again. Hopefully you are not sick of it yet :) Release 0.3 adds five new models: Supertonic 3, MOSS-TTS-Local, MOSS-TTS-Nano, IndexTTS2, and Irodori-TTS. The highlight…
PrismML Bonsai 27B is surprisingly usable on the Jetson Orin Nano 8GB
Ctx Size: 48k Prompt processing: 27t/s Token/s: 4.31 t/s RAM Usage (on cold start): 6.2GB with model loaded (no-mmap) Yes it is not very fast but…
Linear is always a lagging indicator
Article URL: https://remark.ing/rob/rob.mw/-/Linear-is-always-a Comments URL: https://news.ycombinator.com/item?id=48913953 Points: 7 # Comments: 3
Casio FX-870P Emulator
Article URL: https://github.com/urbancamo/fx870p-emulator Comments URL: https://news.ycombinator.com/item?id=48913910 Points: 5 # Comments: 0
LeMario: Training a JEPA World Model on Super Mario Bros
Article URL: https://www.benjamin-bai.com/projects/lemario Comments URL: https://news.ycombinator.com/item?id=48913763 Points: 14 # Comments: 0
So what’s the consensus on 1bit models? Is it still a pipe dream?
With Bonsai 8b at 1bit being 1gb~ size while being functional and the 27b being dropped also at 1bit while only being 5~gb, is the future…
Things I got wrong building an incremental indexing pipeline [P]
I've been working on incremental indexing pipelines lately, basically keeping a vector store in sync as the source data changes, and I keep finding the same…
Probably check on your smart appliances
Article URL: https://xeiaso.net/notes/2026/check-your-smart-tv/ Comments URL: https://news.ycombinator.com/item?id=48913457 Points: 11 # Comments: 1
Financing the AI boom: from cash flows to debt [pdf]
Article URL: https://www.bis.org/publ/bisbull120.pdf Comments URL: https://news.ycombinator.com/item?id=48913443 Points: 23 # Comments: 2
Me: one-shot programming is useless and should not be used as benchmark DeepSeek V4: hold my Atlas 500 SuperPod
Credit goes to: kdzzzds on Bilibili Someone got access to a new version of DeepSeek V4 through A/B testing, and vibe coded / one-shot this No…
Microsoft Deletes User's 25-Year-Old Account with Thousands Spent on Games
Article URL: https://xcancel.com/JoshuaKhane/status/2076918699248803977 Comments URL: https://news.ycombinator.com/item?id=48913220 Points: 59 # Comments: 18
Prism-ML’s Bonsai-27B Benchmarks
We got benchmaxed quants before Qwen3.7 27B https://huggingface.co/prism-ml/Bonsai-27B-gguf https://huggingface.co/prism-ml/Ternary-Bonsai-27B-gguf submitted by /u/token---- [link] [comments]
Microsoft Patches a Record 570 Security Flaws
Article URL: https://krebsonsecurity.com/2026/07/microsoft-patches-a-record-570-security-flaws/ Comments URL: https://news.ycombinator.com/item?id=48913190 Points: 12 # Comments: 3
Dependabot version updates introduce default package cooldown
Article URL: https://github.blog/changelog/2026-07-14-dependabot-version-updates-introduce-default-package-cooldown/ Comments URL: https://news.ycombinator.com/item?id=48913050 Points: 18 # Comments: 2
Same model, same Q4_K_M label: 5.02, 5.07 and 5.27 bits per weight
Article URL: https://github.com/logxio/picchio Comments URL: https://news.ycombinator.com/item?id=48912947 Points: 6 # Comments: 1
GLM-5.2-Int4-Int8 on 8× GB10: ~1,200 t/s prefill, 33–54 t/s avg decode
GLM-5.2-Int4-Int8 on 8× GB10: ~1,200 t/s prefill, 33–54 t/s avg decode (generic - coding/structured) and memory remaining to run also a Mimo 2.5 in parallel for…
Can we get a "not base model" flair?
We have just gotten out of Ornith 2 weeks of spamming and now we start " 1 bit almost fp16 quality" BS. This is just pathetic.…
How I use HTMX with Go
Article URL: https://www.alexedwards.net/blog/how-i-use-htmx-with-go Comments URL: https://news.ycombinator.com/item?id=48912175 Points: 23 # Comments: 1
MTP decoding patched for pre-Ampere GPUs (Kepler/Maxwell/Pascal/Turing)
The current implementation of multi token prediction (MTP) in llama cpp could trigger BF16 compute selection on GPUs that don't support BF16, causing cuBLAS crashes on…