DwarfStar is the only thing I've run that doesn't try and make my Mac Studio 128GB take off. Yes, it gets hot while doing inference but quickly cools down when idling, something I haven't experienced with Ollama, LMStudio or OMLX.
replyCan you run Qwen 3.6 27B on antirez/ds4 now? I thought it was all about the DeepSeek models.
replyNo, I don't think Qwen, but I believe he may try and put some version of GLM in it.
reply