r/LocalLLaMA July 29, 2026 · Communities

I built a GBNF grammar compiler that makes 8B models reliably call tools – here’s how it works (deep dive)

I've been building a local agent in Rust (Eris) that runs on llama.cpp and uses an Obsidian-compatible vault as memory. ~50 tools (vault read/write, memory, reminders, web fetch, email, calendar, vision). The biggest pain was getting small models to emit valid tool-calling JSON. You all know the drill: the model wraps