r/LocalLLaMA
· Communities
vulkan: make TP viable by pwilkin · Pull Request #25051 · ggml-org/llama.cpp
The legend Piotr has taken a pass at making Vulkan Tensor Parallel somewhat usable, really looking forward to seeing this evolve submitted by /u/TKGaming_11 [link] [comments]