Minimus container images are now free
Article URL: https://images.minimus.io/ Comments URL: https://news.ycombinator.com/item?id=48658361 Points: 9 # Comments: 1
Communities 6553 stories
NSA lost access to Mythos amid Anthropic dispute
Unlocked: https://www.nytimes.com/2026/06/23/us/politics/nsa-lost-acce... Comments URL: https://news.ycombinator.com/item?id=48658300 Points: 26 # Comments: 1
What’s everyone using to estimate VRAM/RAM (weights + KV cache) before spinning up a local model?
Hi All, I typically check the model size to estimate if it will fit but I was thinking there should be some better way. There is…
Gemma 4 26BA4B Surprisingly Usable at IQ3_S – Are small quants really this usable?
I've been experimenting with using lower quants of Gemma 4 26B on my M3 16gb MacBook Air. The Quant runs at a solid 25 tokens per…
Risk-Averse AIs
AbstractWe make the case for training AIs to be risk-averse in resources — specifically, to treat resources as having diminishing marginal utility. These AIs would (for…
A deadly fungus that can infect cats and people is spreading
Article URL: https://www.sciencenews.org/article/deadly-fungus-cats-people-spreading Comments URL: https://news.ycombinator.com/item?id=48658186 Points: 30 # Comments: 6
I compiled LLM inference pricing across 7 providers — the caching numbers are surprising(spreadsheet included) [R]
I've been comparing GPU/LLM providers for a side project and ended up with way too many browser tabs and spreadsheets. So I decided to pull the…
Haystack: Open-Source AI Framework for Production Ready Agents, RAG
Article URL: https://haystack.deepset.ai/ Comments URL: https://news.ycombinator.com/item?id=48658095 Points: 3 # Comments: 1
How Baidu’s newly released Unlimited-OCR transcribes dozens of pages in one forward pass
https://i.redd.it/zjduf8zns79h1.gif Baidu released Unlimited-OCR 2 days ago, and they claim it can transcribe dozens of pages in one forward pass. I read the research paper, and…
Too many R packages: CRAN is inundated with submissions
Article URL: https://rworks.dev/posts/too-many-R-packages/ Comments URL: https://news.ycombinator.com/item?id=48657940 Points: 6 # Comments: 0
Qwen3.6 27B more dumb in vLLM compared to llama.cpp
Hello, I recently bought a new RTX 5060Ti to pair with the RTX 5060Ti I already own, now I have 32GB of VRAM. Up until now…
KaLM-Reranker-V1: Fast but Not Late Interaction for Compressed Document Reranking
As retrieval systems scale, high-quality reranking becomes increasingly important. However, most existing rerankers, whether encoder-based or decoder-based, jointly encode the query and passage, tightly coupling their…
Puzzling Success of Overparameterization: Lottery Tickets or Escape Dimensions?
Article URL: https://infoscience.epfl.ch/entities/publication/9a49779b-f9f8-448d-b3d1-737c78455309 Comments URL: https://news.ycombinator.com/item?id=48657481 Points: 5 # Comments: 0
llama.cpp updates – granite-speech-4.1-2b, LFM2.5-ColBERT/Embedding-350M, Vulkan backend related changes & Misc items
Supported Models: granite-speech-4.1-2b-plus by 24818 LFM2.5-ColBERT-350M & LFM2.5-Embedding-350M by 24913 Vulkan: vulkan: link ggml-cpu when GGML_VULKAN_CHECK_RESULTS / RUN_TESTS are enabled #24444 vulkan: make mul_mm ALIGNED a…
Could it be that there aren’t really any medical LLM APIs available right now? [D]
As part of my ablations, I want to generate text with a medical-oriented LLM, and I was surprised to find no exposed APIs for this kind…
You can't unit test for taste
Article URL: https://dev.karltryggvason.com/you-cant-unit-test-for-taste/ Comments URL: https://news.ycombinator.com/item?id=48657049 Points: 208 # Comments: 86
We're making Bunny DNS free: because a faster internet won't build itself
Article URL: https://bunny.net/blog/were-making-bunny-dns-free/ Comments URL: https://news.ycombinator.com/item?id=48657030 Points: 277 # Comments: 89
New EU model (Domyn) will be 400b.
The source is in Italian, but a well respected newspaper (like Financial Times) https://www.ilsole24ore.com/art/frontier-grand-challenge-domyn-guidera-progetto-dell-ai-sovrana-AIgNTNoD?refresh_ce=1 They are a startup that has already created a closed 260b model…
GloriousEggroll's Proton has been rebased on Proton 11
Article URL: https://github.com/GloriousEggroll/proton-ge-custom/releases/tag/GE-Proton11-1 Comments URL: https://news.ycombinator.com/item?id=48656692 Points: 23 # Comments: 1
Ashby (YC W19) Is Hiring EMEA Engineers Who Can Design
Article URL: https://www.ashbyhq.com/careers?ashby_jid=87b96eef-edc1-4de4-adb6-d460126d02f8&utm_source=hn Comments URL: https://news.ycombinator.com/item?id=48656219 Points: 0 # Comments: 0
PCIE 5.0 16x split into 2×8 with riser cable
Hey guys Thanks in advance for your help and knowledge! My setup is born out of the parts I had at hand. Wanting to maximise VRAM…
Qwen-AgentWorld-397B-A17B
It looks like a new model, mentioned on https://huggingface.co/Qwen/Qwen-AgentWorld-35B-A3B and on https://qwen.ai/blog?id=qwen-agentworld submitted by /u/Shoddy_Bed3240 [link] [comments]
Unlimited-OCR is now on ModelScope! A 3.3B multilingual OCR model for one-shot parsing across single images, multi-page documents, and PDFs. License: MIT
Full-document parsing instead of cropped-region OCR 32K output length for long OCR sequences Base and gundam image modes for different document layouts Transformers inference + SGLang…
Qwen-AgentWorld-35B-A3B: a 3B-active MoE trained to simulate MCP, terminal, SWE, Android, web and OS environments
Qwen just released Qwen-AgentWorld-35B-A3B — a 35B-parameter MoE with only ~3B active parameters per token. The interesting part: this is not positioned as a standard chat/instruction…