r/LocalLLaMA
· Communities
In-house LLM Inference on Kubernetes: A Production Runbook
Wrote this as I built the infra at my org. Let me know what you all think... https://gd03.me/writings/inference-infra submitted by /u/GD-Champ [link] [comments]