Skip to content
r/LocalLLaMA · Communities

Is ternary (1.58-bit) LLMs making a come back?

I'm just thinking, ever since microsoft announced bitnet, this sub (and myself) has been hoping for massive ternary models. In the last month alone, prismML dropped 27B ternary (though I've read community experience suggested it sometimes didn't hold up to it's benchmarks), Deepgrove dropped their ternary maple-20b-a1b