Skip to content
llama.cpp releases · Infrastructure

b9982

server: honour per-request reasoning_budget_tokens in chat completions (#23116) server: honour per-request reasoning_budget_tokens in chat completions The reasoning-budget block in oaicompat_chat_params_parse read only the server-level default (opt.reasoning_budget, typically -1) and the Anthropic-style alias thinking_