upvote
LM Studio is fine. Gorgeous actually. I've found it really helpful for understanding parameters, settings, general figuring out.

But there is an incentive not to use it if you want to write an article that uses only open-source tools, because it isn't.

reply
Why would anyone use Ollama at all (aside from obvious reasons one can look up online) - llama.cpp used directly, without this wrapper is faster.

Basically one has two real choices for local LLMs: llama.cpp (if single user) or vLLM (if multi-user/enterprise).

reply
Yeah I’ve also been using it on macOS, my experience is that it works better with the metal API and has better performance.
reply