Skip to content
r/LocalLLaMA · Communities

Pathway’s BDH(post-transformer arch) matches GPT2 scaling from 10M to 1B params trained from scratch. runs on Normal GPUs

submitted by /u/Candid-Tackle-9061 [link] [comments]