r/LocalLLaMA
· Communities
I kept rewriting parameters every time I swapped models on vLLM and llama.cpp, so I built a tool to manage them (llmux, MIT)
llmux dashboard I test a lot of models on vLLM and llama.cpp. Every swap meant editing parameters again, bringing each model up its own way, taking it down, then bringing the next one up. It was tedious and easy to get wrong. So I built **llmux** to manage it. Each model you use is a profile you write once, and after t