r/LocalLLaMA
· Communities
Built Kivarro, an all-in-one local inference workbench. Looking for brutal feedback from people who actually run models locally.
I’ve been building Kivarro, a desktop app for local model inference. The idea is simple: Most local LLM tools solve one slice of the workflow. One app for chat. One app for model files. One script for llama.cpp flags. One dashboard for memory. One terminal for logs. One random note somewhere for benchmark results. I wa