AI safety prizes
Rather than paying up front for AI safety research (push funding), perhaps we should pay after the fact for the work that made the most progress…
Latest
Taboo “equilibrium”: Less confused frames for research on AI bargaining
To understand why powerful AIs might get into conflict, and ways to mitigate it, we need to understand bargaining problems: situations where multiple agents have different…
Parallelization constraints could delay a technological singularity [Linkpost]
Today, I'll be linking both a Epoch blog post and a paper called The Bounded Parallelizability of R&D: Theory and Application to AI, about how standard…
How to Measure Intelligence Beyond Human Scale?
Based on the academic paper: Measuring Intelligence Beyond Human Scale[1]TLDR: Historically, intelligence benchmarks have been composed of human-generated questions. However, current techniques do not scale to…
When you donate can matter more than where
And why our 2023 regrant to Timaeus was goatedWe think the for-profit funding ecosystem has some cool properties. Different funders naturally come in at different stages,…
The AGI Safety and Alignment team at Google DeepMind is Hiring (July 2026)
GDM’s AGI Safety and Alignment Team is hiring for multiple roles. This is the team at GDM, led by Rohin Shah, that aims to reduce existential…
Reward Laundering: LLMs Can Gain Unintended Behaviors by Deciding When to Earn Their Rewards
This work was done by an automated research scaffold developed at Redwood Research. abhayesian provided the initial project idea. The agent designed and ran all experiments…
A Score Is Not Understanding: toward a richer toolkit for model evaluations
We must take great care not to ignore the things that are not easily quantified - Brian Christian, The Alignment ProblemIntroductionModel evaluations have a problem. This…
Orienting Towards Oversight: Which AIs Should Want to Defect?
This post is meant as a background, or "relevant context", for our sequence on AI oversight and its limitations. It can also be read on its…
Why haven't organoids solved all of drug discovery?
Thank you to Jimmy Sastra and Kitchener D. Wilson for discussions relating to this piece. All opinions are my own.What are organoids anyway?If someone placed a…