r/LocalLLaMA
· Communities
[RELEASE] SupraBrain-50M-v0.1
Hey there! So today we're releasing SupraBrain-50M, a hybrid language model that combines Gated DeltaNet linear recurrence with Sliding-Window Attention and Surprise-Gated update mechanisms to deliver very strong performance. Here are the benchmarks: https://preview.redd.it/tv0bxkbyh4hh1.png?width=615&format=png&auto=w