llama.cpp releases
· Infrastructure
b9827
[CUDA] Added a cudaMemcpy2DAsync fast path to ggml_cuda_cpy (#25057) [CUDA] Added a cudaMemcpy2DAsync fast path to ggml_cuda_cpy Add a CUDA ggml_cpy fast path for same-type, same-shape strided copies that are just 2D pitched block copies. When tensors are not fully contiguous but each row is contiguous, it now uses cud