upvote
Yes, llama.cpp does that.
reply