i researched that question for apfel https://github.com/Arthur-Ficial/apfel and standardized API is openai api so thats what i went with
replyOpenAI's API is not local AI.
replyMost local AI servers expose that API.
reply> What is the answer to local AI for Linux?
replyrun an ai api endpoint on a unix domain socket