On Democratizing ASI to Preserve Civil Liberties
I continue to believe we should pause frontier AI development. Any discussion of alternative strategies should be thought of as planning for contingencies. A unifying driver…
Latest
Is Eval Gaming Downstream of Verbalized Eval Awareness? Not when it's reflexive.
Code and data available at github.com/KieronKretschmar/latent-awarenessTL;DRWe take two eval-gaming model organisms (Hua et al.'s (2025) organism and RogueQwen) and apply direct preference optimization (DPO) to their…
Is it ethical to work on general-purpose robots given the risk of totalitarianism?
One potential risk of developing general-purpose robots is that they could greatly reduce the friction required to establish a totalitarian regime. If robots became physically capable…
How to be an AI safety research engineer
This is the advice I wish I had when I started trying to become an AI safety research engineer.The LandscapeStart by working out which issues you…
Hiring Vibe-wrangler Matchmaking Thread
For... idk, at least a few months? I think a briefly useful job is "Guy who basically enters Claude Code prompts for you, but, manages ironing…
How to get answers to questions that confuse you (maybe)
I try to think about topics like desire, causation, and evidence and often find myself in puddles of confusion. I’ve recently wondered how, when someone can…
The Agentic Clusterfuck
Epistemic status: I consider the following future quite plausible in the next few years (~35% chance that something vaguely like this occurs), perhaps as soon as…
AI-amplified democratic backsliding: an exploration
What we did, in a sentence: we built an index that attempts to score countries by their current vulnerability to AI-amplified democratic backsliding. It’s an early…
Overthinking: Amplifying reasoning weights makes models reveal their secrets
If you take the weight difference between a reasoning model and its non-reasoning instruct counterpart, and then apply more of that difference to the reasoning model,…
The Apocalyptic Arrival of Truth
C: Babe, whatever happens, I really appreciate you doing this for me.J: Okay. I still don’t think it’s a good idea.C: Look, it’s a one-time thing.…