r/LocalLLaMA June 25, 2026 · Communities

Fast medical RAG API to give your local LLMs access to facts

I created a simple RAG API using medical Wikipedia articles that you can point your agent to and use freely. It may be useful in allowing your local LLMs access to medical facts they might not be able to recall from their weights. I'm aiming for subsecond responses but cannot guarantee it (it's a free service running o