r/LocalLLaMA
· Communities
RTX5090, gemma-4-31B-it-Q6_K.gguf. Context: before – 35k, after – 80k!
Yesterday there was a message that you can increase the context for Deepseek Flash. But it turned out that everything works for Gemma4 too! function dockergemma () { docker run -e GGML_CUDA_NO_PINNED=1 -p "$PORT_GEMMA":"$PORT_GEMMA" -v "$LLM_PATH" -v "$WORKSPACE_PATH" --gpus "$LLM_GPU1" "$LLM_DOCKER_IMAGE"