Skip to content
llama.cpp releases · Infrastructure

b9969

Vulkan: route large matmuls to medium tile on Adreno (#24877) [Vulkan] Fixes llama-cli breaking over longer promts sizes The llama-cli was breaking for longer promts sizes for q4_0 quantized networks. Causing due to insufficient shared memory. Removed the un-used Adreno device Updated matmul for small pipeline. macOS/i