Made an interactive explainer about speculative decoding/MTP
submitted by /u/undefdev [link] [comments]
Latest
RT Lazarz: Probably the most important type of knowledge that gets shared way to rarely in all science areas tbh It’s like: I love your new algorithm…
RT LazarzProbably the most important type of knowledge that gets shared way to rarely in all science areas tbhIt’s like: I love your new algorithm and…
Linux Foundation and 20 tech giants launch Akrites to fix open-source flaws before AI-powered attacks hit
About twenty tech companies, AI labs, and banks are joining forces through Akrites to fix vulnerabilities in critical open-source software before AI tools can exploit them.…
¿Qué?
¿Qué?Michael: Most political compass tests are stupid and outdated, so I have created a political test that only focuses on REAL ISSUES of the 2020s. 64…
Previewing GPT-5.6 Sol: a next-generation model
OpenAI previews GPT-5.6 Sol, a next-generation model with stronger capabilities in coding, science, and cybersecurity, paired with its most advanced safety stack.
> the risk of *epistemic exposure* [to Chynese LLMs] man, Finns are not okay. Just how deranged can you be?
> the risk of *epistemic exposure* [to Chynese LLMs]man, Finns are not okay. Just how deranged can you be?Sari Arho Havrén: From Beijing's perspective, the move…
Help optimizing llama.cpp + Qwen 27B on RTX PRO 6000 Blackwell for coding agents
Our company recently acquired a workstation with an RTX PRO 6000 Blackwell, and we're experimenting with local LLMs to reduce part of our Claude token usage.…
Meet container: Apple’s Open-Source Swift Tool for Running Linux Containers as Lightweight VMs on Apple Silicon
Apple released container 1.0, an open-source Swift tool running Linux containers as lightweight virtual machines on Apple silicon. The post Meet container: Apple’s Open-Source Swift Tool…
RT Williams_Wang: Re @ZeffMax Because Dario sees himself as the high priest of the AI era, the only one qualified to stand between the most advanced m…
RT Williams_WangRe @ZeffMax Because Dario sees himself as the high priest of the AI era, the only one qualified to stand between the most advanced models…
RT 🤷 Nico Martin: Apertus Mini is now running entirely in your browser 🇨🇭 80+ tps for the 1.5B, 60+ tps for the 4B (on my M3). Fully client-s…
RT 🤷 Nico MartinApertus Mini is now running entirely in your browser 🇨🇭80+ tps for the 1.5B, 60+ tps for the 4B (on my M3). Fully…
OpenAI's GPT 5.6 rollout now requires US government approval on a "customer by customer basis"
At the request of the U.S. government, OpenAI will initially make its new GPT-5.6 model available only to select partners, with access approved on a "customer…
RT WELT: In Deutschland ohne Freigabe – Elon Musk stellt ganzen Film von Uwe Boll bei X online http://to.welt.de/QRrI3OS
RT WELTIn Deutschland ohne Freigabe – Elon Musk stellt ganzen Film von Uwe Boll bei X online http://to.welt.de/QRrI3OS
RT Daniel Jeffries: It doesn't take much skill to game this out and see where we're going if we keep this up. Kneecap our own companies. Gate everythi…
RT Daniel JeffriesIt doesn't take much skill to game this out and see where we're going if we keep this up.Kneecap our own companies. Gate everything.…
RT Coocoo: Re @teortaxesTex I wonder what the average European have to say about chINeSE oVERcaPACiTy right now https://x.com/LEDx2000/status/20698583…
RT CoocooRe @teortaxesTex I wonder what the average European have to say about chINeSE oVERcaPACiTy right nowhttps://x.com/LEDx2000/status/2069858340440584277Fml: @CeliaBedelia Yesterday i found out, someone even made a…
> you cannot roll out air conditioning across Europe at the scale and speed needed to solve immediate problems such as the current heatwave …I guess …
> you cannot roll out air conditioning across Europe at the scale and speed needed to solve immediate problems such as the current heatwave…I guess the…
Build a Nanobot-Style AI Agent in Google Colab with Tool Calling, Session Memory, Skills, and MCP Servers
In this tutorial, we build a lightweight personal AI agent inspired by the architecture of nanobot, runnable entirely in Google Colab. We start from a provider…
CoffeeBench: Benchmarking Long-Horizon LLM Agents in Heterogeneous Multi-Agent Economies
As LLM agents become capable of increasingly long-horizon tasks, evaluating their performance in economic systems is becoming increasingly important. Unlike existing benchmarks that primarily evaluate a…
Why current LLM costs are not sustainable
Article URL: https://aditya.patadia.org/p/ai-and-cloud-costs Comments URL: https://news.ycombinator.com/item?id=48683588 Points: 28 # Comments: 7
The yet unconquered frontier for open weights LLMs:
The yet unconquered frontier for open weights LLMs:GDP: Kind of questions where GLM 5.2 trips over (so does Opus 4.6, only Opus 4.8 does a pretty…
RT Daniel Jeffries: There will be more and more pressure and more money and lobbying behind open soon. It is not a "two big companies have all the pow…
RT Daniel JeffriesThere will be more and more pressure and more money and lobbying behind open soon. It is not a "two big companies have all…
b9804
mamba2: remove hardcoded 2x expansion factor and invalid d_inner % d_state check (#23082) mamba2: remove hardcoded 2x expansion factor, support any expand value mamba2: remove invalid…
Don't ignore the car crashes, and remember your freshman CS
Car crashes kill over 35,000 people in the US every year. Plane crashes, on the other hand, kill ~350. Despite this, we have shows like Mayday/Air…
RT lily zhang: http://x.com/i/article/2069838668370673665
RT lily zhanghttp://x.com/i/article/2069838668370673665
Summary of METR's predeployment evaluation of GPT-5.6 Sol
Note on independence: This evaluation was conducted under a standard NDA. Due to the sensitive information shared with METR as part of this evaluation, OpenAI’s comms…