Skip to content
r/LocalLLaMA · Communities

AMD Kernel Optimizations in llama.cpp

Is it a thing? i use kernel-anvil added to llama.cpp, but wondering if theres others out there ? Heres a link i found for vLLM - GEAK v4 submitted by /u/uber-linny [link] [comments]