r/LocalLLaMA
· Communities
Don’t want to be that guy, but… Bonsai (1-bit and Ternary) vs ThinkingCap (@2.5-bit) – Pareto of generated tokens vs accuracy, model size vs accuracy.
as long as you use Instruct it won't matter... once you need to plug reasoning in you'll feel the lobotomy. Tiny sample since nobody pays my electricity bill. submitted by /u/JLeonsarmiento [link] [comments]