r/LocalLLaMA
· Communities
I built my first major software project around a local AI server utilizing Llama.cpp. I want people to try to break it.
I've been working on Redstart for the last couple of months. It started as an experiment in building a better local AI setup and turned into something a lot bigger than I originally had planned. I found this sub about a week ago while doing research on open source models and I've picked up a fair amount just from readi