r/LocalLLaMA
· Communities
The best harness for local LLM is the one you code
Hi, After some tries, it seems that for local models (27B+) the best way to have reliable outputs is to add a little more code and have a determinist context for loop iteration. If you can code in Java (or use a LLM to code in Java), https://github.com/openconcerto/jOpenAgent could interest you. Feedback welcome :) sub