Skip to content
llama.cpp releases · Infrastructure

b9862

Remove redundant CUDA copies after gated_delta_net. (#23940) Remove redundant CUDA copies after gated_delta_net. Currently, GDN writes recurrent state snapshots into its output tail, then the graph immediately copies those snapshots into ssm_states_all. With MTP draft length 3, target decode uses K=4, so that becomes 4