LessWrong AI
· Communities
Does routine compression undo LLM unlearning? A short project
I completed this project over 2 weeks as part of a BlueDot Project cohort. It was my first solo project and I learned a lot! Feedback is super welcome :)Code and full results: GitHubTLDR: I tested if standard post-training compression processes (quantization, magnitude pruning, SVD truncation) reverses unlearning on TO