Quadrillion Param Costs: KV Cache, Context Length, Frontier Margins
The models of 2028-2031 get much bigger than the models of 2026, going from 10T total params in 2026 to maybe 240T params in 2028 [1]…
The models of 2028-2031 get much bigger than the models of 2026, going from 10T total params in 2026 to maybe 240T params in 2028 [1]…
Article URL: https://eaton-works.com/2026/07/27/my-eicher-hack/ Comments URL: https://news.ycombinator.com/item?id=49070756 Points: 3 # Comments: 0
Where is KIMI-K3 Where is KIMI-K3? submitted by /u/mossy_troll_84 [link] [comments]
If you're training any type of toy model of superposition, Mean Squared Error (MSE) loss is unusually bad. [1] Related work We aren't the first to…
Q1: What are you saying?A: My claim here is that if you build artificial general intelligence (AGI) via any algorithm that’s choosing actions via reinforcement learning…
Article URL: https://www.macrumors.com/2026/07/27/ed-zitron-apple-watch-it-burn-ai-bubble-bursts/ Comments URL: https://news.ycombinator.com/item?id=49070427 Points: 92 # Comments: 32
Article URL: https://pagedout.institute/download/PagedOut_009.pdf Comments URL: https://news.ycombinator.com/item?id=49070138 Points: 22 # Comments: 3
tldr; we are going to host K3 on A100s (yes, thats correct, we'll try to see if it holds up), H200s & B300s - expect results…
Nvidia CEO Jensen Huang “Distillation - learning from AI, learning from other people, and learning from other sources of knowledge, is fundamental to intelligence. We are…
“China is working hard to catch up, and the United States should take steps to keep its advantage. Most important, it should continue to prohibit American…
Article URL: https://www.ft.com/content/d8a5f95e-3b6d-463a-a848-c9ef8e2394db Comments URL: https://news.ycombinator.com/item?id=49069939 Points: 5 # Comments: 1
I've been building Krasis, an MoE-focused runtime for streaming big models through limited VRAM on NVIDIA consumer/workstation GPUs, and I think this is the most interesting…
Article URL: https://www.gavinmai.com/1736354308000-diy-home-solar-backup-system Comments URL: https://news.ycombinator.com/item?id=49069791 Points: 15 # Comments: 3
Hello, I read a paper on a model named DONUT that extracts text from documents, which became my inspiration for this little project. Initially I wanted…
i get curious about this a lot, and majority of the times i get a response which is similar to mine that is : it fulfills…
Article URL: https://www.rtings.com/air-fryer/learn/research/ptfe-cookware-shedding Comments URL: https://news.ycombinator.com/item?id=49069447 Points: 36 # Comments: 17
In a recent post, we presented PIRAMID, its leadership and research pillars, and a plan for how they fit together. In this post, we sketch a…
Article URL: https://incoherency.co.uk/blog/stories/should-you-wash-your-solar-panels.html Comments URL: https://news.ycombinator.com/item?id=49069132 Points: 23 # Comments: 8
Article URL: https://brittany-ellich.offprint.app/a/3mrjj34puva23-108-prs-in-eight-days-accidentally-discovering-loop-engineering Comments URL: https://news.ycombinator.com/item?id=49068870 Points: 12 # Comments: 4
submitted by /u/arsenyinfo [link] [comments]
My weekend sideproject was implementing the paper 'Approximating Softmax for FPGAs with Taylor Series and Pade Approximants' The paper’s motivation is the hardware constraints limiting exponential…
Article URL: https://xcancel.com/HedgieMarkets/status/2081534588485296565 Comments URL: https://news.ycombinator.com/item?id=49068738 Points: 47 # Comments: 7
Article URL: https://incredible.pm/ Comments URL: https://news.ycombinator.com/item?id=49068711 Points: 4 # Comments: 0
Article URL: https://ledger.worseonpurpose.com/brands Comments URL: https://news.ycombinator.com/item?id=49068707 Points: 8 # Comments: 0