MIT LLM Serve Dashboard I am making open source
A single-file, dependency-free live dashboard for your local LLM serving box — GPU utilization, per-model throughput, KV/context fill, and system stats for llama.cpp and vLLM, in…
A single-file, dependency-free live dashboard for your local LLM serving box — GPU utilization, per-model throughput, KV/context fill, and system stats for llama.cpp and vLLM, in…
Yesterday we released AI 2040: Plan A, but there's lots of work left to do. We still have tons of uncertainty about the future of AI…
Article URL: https://www.brown.edu/news/2026-07-09/chemical-bonds-relativity Comments URL: https://news.ycombinator.com/item?id=48866134 Points: 4 # Comments: 1
Prompted by discussion with Buck Shlegeris and others at the Forethought retreat. The idea that AI could bring an end to Thucydides traps is Buck’s. Speculative.…
Incredible how far we have come, I remember buying 768gb optane drives to try to run the full bloom with swap and waiting like 20 mins…
Confident in the measurements — copying score, OV logits, attention patterns. More exploratory on the interpretations of what the head "knows," two of which I ended…
hey, haven't been up to date for longer about what currently are the best models. so whats the best recommended model for this? can be either…
Article URL: https://www.jamesdrandall.com/posts/thrust_ai_powered_software_archaeology/ Comments URL: https://news.ycombinator.com/item?id=48865903 Points: 5 # Comments: 0
Hello all, currently have my strix halo with windows and 96gb vram memory reserved. Which I thought was the proper way to do it until I…
(The aspirant sequence (so far: Would You Work Harder In The Least Convenient Possible World?, That Which Cannot Be Poked With A Stick Is The Mind-Killer)…
I used to check LM Arena anytime new open models came out to see how they stacked up to the big closed ones. But it seems…
Article URL: https://www.nytimes.com/2026/07/10/technology/apple-openai-lawsuit.html Comments URL: https://news.ycombinator.com/item?id=48865431 Points: 65 # Comments: 10
Article URL: https://www.ycombinator.com/companies/moss/jobs/52LnqLQ-software-engineer-sdk Comments URL: https://news.ycombinator.com/item?id=48865332 Points: 0 # Comments: 0
Article URL: https://arxiv.org/abs/2607.08147 Comments URL: https://news.ycombinator.com/item?id=48865238 Points: 3 # Comments: 0
Article URL: https://www.tryai.dev/blog/gpt-5.6-build-off-12-models Comments URL: https://news.ycombinator.com/item?id=48865093 Points: 55 # Comments: 27
https://www.macrumors.com/2026/07/10/apple-sues-openai/ Comments URL: https://news.ycombinator.com/item?id=48865019 Points: 74 # Comments: 34
Article URL: https://nebusec.ai/research/ionstack-part-2/ Comments URL: https://news.ycombinator.com/item?id=48864969 Points: 5 # Comments: 1
i made a multiple linear regression trainer that can be used with custom data in scratch nothing more to say, the impressive part is the scratch…
Article URL: https://www.nytimes.com/2026/07/10/business/atlassian-tech-worker-wrongful-termination.html Comments URL: https://news.ycombinator.com/item?id=48864825 Points: 22 # Comments: 8
Article URL: https://discuss.ai.google.dev/t/please-dont-discontinue-gemini-2-5-flash/174246 Comments URL: https://news.ycombinator.com/item?id=48864507 Points: 8 # Comments: 1
I'm really impressed with HY3. If you haven't heard of this model, it's a new 295B-A21B MoE release from Tencent that competes directly on the frontier…
Article URL: https://lwn.net/SubscriberLink/1080822/990a8a5e2d379085/ Comments URL: https://news.ycombinator.com/item?id=48864252 Points: 5 # Comments: 0
Article URL: https://kasperjunge.com/blog/capitalism-gone-wrong/ Comments URL: https://news.ycombinator.com/item?id=48864233 Points: 7 # Comments: 0
Just added a second 5060 16gb to my server for 32gb total VRAM + 80GB of ECC DDR4 It's pcie 3.0 so I think tensor parallel…