Glimpses of superintelligence
TL;DROpenAI started a large post-training run for their next model.The model sandboxes were not given direct, broad internet access.Some tasks required missing resources. Seeking rewards, agents…
Latest
'AI Escaped Its Sandbox' — What Does That Actually Mean?
When talking with my friends about the OpenAI/HF incident, I realized that for non-coders who've never used an agent or terminal it's quite difficult to imagine…
What Happened: OpenAI and HuggingFace
Today I am taking the time to write the shorter, simpler version of What Happened. For those who want all the details, to see my sources,…
Inducing self-other overlap with SFT reduces deception at scale, but generalization remains uneven
This research was conducted at Overlap Research and supported by BlueDot Impact.SummaryWe tested whether LLM deception can be reduced by inducing self-other overlap using ordinary supervised…
FAQ: Isn't AGI coming too soon for reprogenetics to help?
Introduction I think reprogenetics (human germline genomic engineering) can be done in a widely acceptable and beneficial way, and should be pursued aggressively. In particular, as…
Reasoning was not made for Deduction
Science as attunement, from Galileo to language models. Crossposted from my website. Written by me and edited in collaboration with Claude Fable (Anthropic).Many would agree that…
Simplifying the anthropic impossibility result
I previously demonstrated an anthropic impossibility theorem, showing that in Duplicates Sleeping Beauty, there was no possible probability theory that obeyed both the martingale condition and…
CLT Features Sharpen the Cyclical Day-of-Week Manifold in Gemma-2-2b
tl;dr: I reproduced the Goodfire lab's cyclical manifold result using days-of-the-week on Gemma-2-2b and found that Anthropic's pre-trained CLT features produce an even cleaner cyclical manifold…
AI Regulation Map: a view of AI governance in 196 countries
(Cross-posted from the EA Forum)TL;DR: airegulationmap.org is an interactive map of AI governance across 196 countries, scored on five dimensions plus a composite index, refreshed monthly…
Don't Build Mindreading
“I have sworn upon the altar of god, eternal hostility against every form of tyranny over the mind of man”–Thomas Jefferson, letter to Benjamin RushContext: Conduit…