r/LocalLLaMA
· Communities
CachyLLama: llama.cpp fork with persistent SSD-backed KV caching for local agent workflows
If you run local agentic coding harnesses (Aider, Claude Code, etc.), prompt evaluation usually eats up most of your execution time. Every turn re-evaluates thousands of identical prefix tokens_system prompts, tool schemas, and conversation history. CachyLLama is a llama.cpp fork built specifically to solve this bottle