Once image support drops this could be a cool addition to https://struktur.sh. Will it be on OpenRouter too or will all inference have to be self-managed? I’m thinking about server-side use cases, where budgets are low, so small models shine.
edit: ah I saw mainly iOS for now. But an integration would be possible on macOS then, right?
We aim to make all our models available cross-platform. There's a subset currently only iOS/macOS, because they take some more effort to port over to Android and web.
Check out the CLI for easy experimentation: https://github.com/Desert-Ant-Labs/desert-ant-cli#desert-ant...