Highly recommend just dropping Ollama. You can download binary releases of llama.cpp for every platform and run them trivially in 5 seconds. Ollama serves no purpose other than to take open source work and rebadge as its own, while providing inferior functionality
replySince ollama has diverged from llama.cpp, it will take a bit of time for ollama to support multi-modality. If you're using plain llama.cpp it looks like a PR has already merged for this model with vision and audio support:
replyThey've actually gone back to (a lightly patched) llama.cpp with the 0.30 release a few weeks ago, and have now vendored-in an up to date release. Needless to say this is great news for both projects!
replyJust use llama.cpp or Unsloth Studio which wraps it, I don't know why anyone use Ollama anymore.
replyI switched from llama.cpp to vLLM because of prompt cache bugs in qwen/gemma models
replyThis is a good starting issue with a bunch of linked/related
To anybody else wondering: Seems like the models supporting image input are just starting to show up. https://ollama.com/library/gemma4:12b-mlx now shows as supporting it, but curiously the overview on https://ollama.com/library/gemma4/tags still lists it as text only. Cache invalidation remains difficult :)
replyYup, the new version of Ollama dropped. Time to update.
replyStop using ollama
replyOllama is a shitty project that steals from the open source community, don't use it, use llama.cpp instead.
reply