For those wondering how to do this:

  OLLAMA_CONTEXT_LENGTH=64000 ollama serve

or if you're using the app, open the Ollama app's Settings dialog and adjust there.

Codex also works:

  ollama launch codex --model gemma4:26b