r/LocalLLaMA
· Communities
Laguna-S-2.1 "thinking forever" loops seem to be a quantization artifact
If you're running Laguna S 2.1 on llama.cpp and hitting thinking loops because it won't close its tags, you might want to look at your quant before you spend too much time tweaking settings. I spent a day debugging this, and here is what finally gave me clean outputs: 1. What worked for me: An MoE-Aware Quant