X · @dwarkesh_sp
· X / Twitter
The least verifiable part of AI R&D (and the thing which may bottleneck the automated researchers) is making calls on large experiments and big traini…
The least verifiable part of AI R&D (and the thing which may bottleneck the automated researchers) is making calls on large experiments and big training runs.Interestingly, this may also partly explain why model parameter scaling has been slow for the last few years.Even for human AI researchers, it's better to run mor