r/LocalLLaMA
· Communities
2 x 5070ti Qwen 27B full config / stats
Following up on yesterday's post about running everyone's faves on 2 x 16gb cards while maximizing performance and KV. Previous post data used abandoned Cu130 VLLM image. Stats here are done on cu129-nightly. Which has the KV cache connector fixes and performance improvements. Highlights - 2 concurrent threads run comf