Third-party evaluation to identify risks in LLMs’ training data
An overview of the minetester and preliminary work
Latest
Mechanistic Anomaly Detection Research Update 2
Interim report on ongoing work on mechanistic anomaly detection
RLHF and RLAIF in GPT-NeoX
GPT-NeoX now supports post-training thanks to a collaboration with SynthLabs.
The Practitioner's Guide to the Maximal Update Parameterization
Exploring the implementation details of muTransfer
Mechanistic Anomaly Detection Research Update
Interim report on ongoing work on mechanistic anomaly detection
Open Source Automated Interpretability for Sparse Autoencoder Features
Building and evaluating an open-source pipeline for auto-interpretability
Experiments in Weak-to-Strong Generalization
Writing up results from a recent project
Free Form Least-Squares Concept Erasure Without Oracle Concept Labels
Achieving even more surgical edits than LEACE without concept labels at inference time.
VINC-S: Closed-form Optionally-supervised Knowledge Elicitation with Paraphrase Invariance
Writing up results from a project from Spring 2023
Yi-34B, Llama 2, and common practices in LLM training: a fact check of the New York Times
Setting the record straight regarding Yi-34B and Llama 2.