r/LocalLLaMA
· Communities
ggml-cpu: use UE4M3 LUT in ARM NVFP4 dot product by ragz4125 · Pull Request #25331 · ggml-org/llama.cpp
Overview This PR extends the UE4M3 lookup table optimization introduced in #23961 to the ARM implementation of the NVFP4 dot product. The ARM implementation now uses the existing GGML_CPU_UE4M3_TO_FP32 lookup table for UE4M3 scale decoding. This aligns the ARM implementation with the x86 implementation while reusing th