b9913
Add Q2_0 quantization: type definition and CPU backend (#24448) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework…
Latest
b9912
spec : fix naming, spacing (#25410) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64…
b9911
CUDA: Fuse MMVQ post-scale for NVFP4 (#24481) CUDA: Fuse MMVQ for NVFP4 and BS 1 TODO: Add tests to test-backend-ops (did verify correctness manually for one…
b9917: fix: OOB reads in UGM tokenizer (precompiled_charsmap handling) (#18750)
fix: OOB reads in UGM tokenizer (precompiled_charsmap handling) Validate minimum size (4 bytes) before reading xcda_blob_size Use strnlen with bounds check instead of unsafe strlen Both…
b9910
server : fix draft model fit vs load inconsistency (#25056) fix: draft model fit vs load inconsistency refactor(server): unify draft/mtp parameter initialization, model, and context load…
b9909
server : add timings and progress to /responses API stream (#25348) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64)…
b9908
server: enforce prompt cache RAM limit (#25070) Before this commit, --cache-ram was not a hard limit: The cache always kept at least one entry, even if…
b9907
common : add missing include in common.h (#25220) Signed-off-by: zhangrunda zhangrunda1234@outlook.com macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64)…
b9906
ggml-hip : add -fno-finite-math-only alongside -ffast-math (#25373) -ffast-math implies -ffinite-math-only under ROCm/clang 22, which disables INFINITY/NaN and triggers -Wnan-infinity-disabled (errors under -Werror in CI). Re-enable infinity…
b9905
llama: fix quantized kv-cache for dsv4 (#25202) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu…