b9938
ggml-hip: enable -funsafe-math-optimizations (#24668) CUDA is compiled with fast math and AMD/HIP is not — this flag lets AMD use fast math too. We can't use…
Latest
b9937
cuda: align snake fusion matcher with the other backends (#25460) cuda: fix snake fusion type predicate, a and inv_b are F32 The matcher required a->type ==…
b9936
server : respect min-step when splitting prompt batches (#25420) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework…
b9935
hexagon: add VISION RoPE support (#25216) hexagon: add VISION RoPE support hexagon: support RoPE on strided half-dim views for all modes hex-rope: decouple src0 DMA copy…
b9934
ggml-webgpu: tune subgroup split (d_split) in flash_attn_vec (#25418) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux:…
b9933
opencl: Q6_K GEMM/GEMV fix for ne01 of weights that are not multiples of 128. (#25464) opencl: fix garbled output for Q6_K weights with ne01 % 128…
b9932
vulkan: disable FA mask_opt on GCN to improve performance (#24362) vulkan: disable FA mask_opt on GCN to improve performance reenable mask opt over attention head size…
b9931
opencl: ragged-tile MoE prefill FP16 GEMM optimization (skip padded expert tiles) (#25433) opencl: ragged-tile MoE prefill GEMM (skip padded expert tiles) The MoE prefill GEMM groups…
b9930
llama-batch: fix allowed decreasing pos in a seq (#25449) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework…
b9929
vulkan: for small AMD GPUs, reduce submission threshold based on CU count (#25240) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS…