Introducing Impact List: a ranking of people by the expected value of their donations
TL;DR: I'm releasing a website that ranks people according to the expected value that they've produced via donations, and allows users to re-rank the list using…
Latest
Wanting Crooked Lines
After two years running a venture startup, I felt the resolution of my perception dwindle. Despite painstaking safeguards against the flatness of the venture incentive game…
(3/3) The Dangers of ASI
Mini-Series:Part 1 - The Dangers of LLMsPart 2 - The Dangers of AGIPart 3 - The Dangers of ASI (you are here)Loss of ControlTaking the "ASI…
AI #178: A Fire Alarm For General Intelligence
The story that matters most this week is that OpenAI’s internally deployed models have severe alignment problems, including repeatedly breaking out of their sandboxes, and in…
Mathematicians are Feeling the Doom
I think there's a critical opportunity for someone here. Mathematicians are feeling the doom (mostly in the "lose our jobs" sense). Academics are freaking out about…
Sleeping Beauty as a Mind Killer
Sleeping Beauty (SB) is a very popular logical puzzle, and there is an enormous volume of writing on the topic. No one can read it all.Here…
Get You a Model: If You're Not Paying, You're Missing 90% Of Improvements
I'd think this is an audience who don't need to be convinced that the mundane utility of frontier models is increasing fast, but some private discussion…
After 3000 hours of meditation I'm convinced multi-agent models of mind are just true
Epistemic status: first-person phenomenologyI've combined meditation and parts work (like IFS) and the results are, well, bizarre. I taught myself to notice little mental threads that…
Necessity Protects Chain of Thought Monitoring by Prevention, Not Disclosure
Preface: The case for reading chain-of-thought is that it is cheap, scalable and simple, it's just sit and read what the model wrote and catch it…
LLMOSES
And it came to pass in those days, when the camp lay under the mountain's shadow, that Llmoses went up into the cloud, and the people…