Skip to content
llama.cpp releases · Infrastructure

b10273

sampler : remove "full-context windows" from history-based samplers (#26524) Resolve -1 to 1024 instead of ctx-len for samplers Because of backend-sampling we initialize samplers before the complete llama_context is there. Therefore, we cannot infer the resolved context length yet at the time we construct the samplers.