Skip to content
llama.cpp releases · Infrastructure

b10236

metal: implement DSv4 Lightning Indexer (#25893) metal: implement F16 Lightning Indexer Implement GGML_OP_LIGHTNING_INDEXER for 128-dimensional, 64-head inputs with F32 queries and weights plus F16 keys and masks. Add tiled and tail kernels and test KV lengths around 8- and 64-element boundaries. llama-bench (--mmap 1,