Skip to content
llama.cpp releases · Infrastructure

b9931

opencl: ragged-tile MoE prefill FP16 GEMM optimization (skip padded expert tiles) (#25433) opencl: ragged-tile MoE prefill GEMM (skip padded expert tiles) The MoE prefill GEMM groups tokens into TILESIZE_N=32 per-expert tiles; at low tokens-per-expert most tiles are mostly padding. When a tile's upper 16 slots are all