r/LocalLLaMA
· Communities
Using the Bonsai 27b 1b quant locally – regularly.
I've been using the 1bit quant of prismml's bonsai 27b for local conversation, casual chat/ literature review for fun (i throw random stuff from my notes app to see how it analyzes it, those texts don't exist on the internet). I've been using it as a "tutor" in many cases, for example I am currently learning golang and