upvote
reply
Does this have a CLI only interface?
reply
Yes. You could also look at the README.md.
reply
That also comes upstream from llama.cpp https://github.com/ggml-org/llama.cpp/discussions/4345
reply