Who ONLY use local models?
Please be honest. I would love to hear about guys really dedicated to local AI and who really reject subscriptions (especially to openai and anthropic). What…
Communities 7218 stories
ModelExpress: Distributing Model Artifacts at the Speed of Light – NVIDIA Technical Blog
We cut DeepSeek-V4 Pro startup from 8 minutes to under 2 minutes by moving weights over the fastest path to GPU memory with GPU-to-GPU RDMA. This…
The Viable System Model & Multi-Scale Agency
AI was used to generate the scary science attack section in a different voice than the original part was written through as well as creating diagrams…
MouthPad: A Tongue-Controlled Touchpad
Article URL: https://www.augmental.tech/ Comments URL: https://news.ycombinator.com/item?id=49045446 Points: 4 # Comments: 0
Setup for always on assistant
I have a dual 3090 rig that I use as coding assistant and while it works, it draws a lot of electricity. Now I want to…
Any idea about these jailbreaks?
Do you guys have any idea what these jailbreaks are? I searched, but I couldn't find any. submitted by /u/Suhan_XD [link] [comments]
Android May Soon Restrict On-Device ADB
Article URL: https://kitsumed.github.io/blog/posts/android-may-soon-restrict-on-device-adb/ Comments URL: https://news.ycombinator.com/item?id=49045159 Points: 18 # Comments: 5
ARC-AGI Leaderboard
Article URL: https://arcprize.org/leaderboard Comments URL: https://news.ycombinator.com/item?id=49045040 Points: 9 # Comments: 1
Extinct Media Museum Tokyo
Article URL: https://extinct-media-museum.blog.jp/otemachi/ Comments URL: https://news.ycombinator.com/item?id=49044874 Points: 10 # Comments: 1
Neurips Position Track Rebuttal and Reviews [R]
Hello! This is my first time submitting an actual conference paper (only done workshops so far). Got a 3/3/5/7 for the Position Paper Track. Reviews all…
UK AISI / Caisi Preliminary Assessment of Kimi K3's Cyber Capabilities
Article URL: https://www.nist.gov/news-events/news/2026/07/uk-aisi-caisi-preliminary-assessment-kimi-k3s-cyber-capabilities Comments URL: https://news.ycombinator.com/item?id=49044492 Points: 9 # Comments: 0
PSA: DO NOT use Intel consumer platforms for multi-GPU setups
Since a lot more people are trying to build their own multi-GPU machines, I thought I should help to prevent a common mistake people make with…
DKV: Open-source KV-cache compression framework for local LLM inference (CLI + technical report)
Hi everyone! Over the past five months I've been working on DKV (DifferentialKV), an open-source project exploring KV-cache compression for long-context local LLM inference. The goal…
I still didn’t get my NeurIPS meta review [D]
About to be over 36 hours now? Nothing on the website, twitter, anywhere. What the hell? Is anyone else facing the same issue what do I…
Taylor Farms Called White House to Try to Delay Cyclospora Recall
Article URL: https://www.wsj.com/health/taylor-farms-cyclospora-recall-delay-call-41fef0bc Comments URL: https://news.ycombinator.com/item?id=49044074 Points: 49 # Comments: 6
OrangePi AI Studio Pro – Qwen3.5-122B-A10B
https://preview.redd.it/wbq8ullnbafh1.png?width=1409&format=png&auto=webp&s=e6d2fe2b1c87c724bc64003c25f917dcee53260f I finally got round to tweaking this, with a bit of help from GLM5.2. The trick to getting it running with vLLM (which I couldn't…
I released Inflect v2: two ultra-tiny complete TTS models under 4M and 10M parameters
I’ve spent the past month trying to find the point where an extremely small TTS model stops feeling like a size experiment and starts feeling genuinely…
SONI: Selective Orthogonalisation via Noise Injection
This project was completed as a capstone for TARA. All code is available in github.TL;DRThe Problem: Neural networks use superposition to pack many concepts into small…
Can Recursive Self-Report Probing Detect Emergent Misalignment?
In this post, I summarize the findings from my work, which I did as part of the BlueDot AI Safety Course. The full code is available…
Microsoft’s website shows OpenAI as one of the signatories of the open weight AI letter
https://preview.redd.it/a24z80gr6afh1.png?width=1181&format=png&auto=webp&s=4a844ebe2319eb6230dbdc63c9caf492bed5ff47 So, this came up on: https://www.microsoft.com/en-us/corporate-responsibility/topics/open-weight/ Archived version is case it disappears: https://archive.is/16Oxc submitted by /u/x0wl [link] [comments]
Hannah Fry Wins the Leelavati Prize in 2026 for Mathematics Outreach
Article URL: https://www.maths.cam.ac.uk/features/professor-hannah-fry-wins-leelavati-prize Comments URL: https://news.ycombinator.com/item?id=49043724 Points: 21 # Comments: 6
Linear probes tell you where quantization will hurt
Epistemic status: I have only tested one encoder family (BERT-base and its relatives) and one decoder LLM (Qwen2.5-3B), one seed, token-level tasks, and post-training weight quantization.…
Orbit: A framework for multi-agent security evaluations
This post announces work completed as part of the MATS 9 program, supervised by Dr. Christian Schroeder de Witt. Moving forward, Orbit will be supported by…
“Wait, feelings are supposed to be IN THE BODY?”
Mentor: “…and how do you feel in your body about that?”Me: “Wait, feelings are supposed to be IN THE BODY?”For the first few months after this…