r/LocalLLaMA
· Communities
New Muse-Glimmer-30B SoTA Quants – hopefully a new lineup :)
Hey Folks, I've been making quants for a while - recently I took a short break to get into hardcore research (submitted my first EMNLP paper during it!). Along the way, I built up a little arsenal of quant-optim techniques: everything from novel, paper-pending tricks to some genuinely sick tensor-mapping algos. I threw