X · @teortaxesTex
· X / Twitter
Very interesting
Very interestingGrigory Sapunov: 1/Judging a neural network by its weight magnitudes is like judging a book by weighing its ink. Scale symmetries mean massive weights might be artifacts, while small ones hide key features. We need to stop looking at parameters. 🧵