r/LocalLLaMA June 25, 2026 · Communities

My current NL to SQL generation solution. Looking for tips to Improve

I’ve been building a fully local NL → filter generation system on a low-end laptop with no GPU and limited RAM using Qwen3 4B Instruct running through llama.cpp with CPU-only inference. Instead of generating SQL directly, the model only handles semantic intent and structured filter selection while a deterministic query