Still shoring up the details but you can try a sample of all the options and see how they compare in terms of model size, peak RSS, real time factor etc.
Linux on desktop is great for you, but this is a tool for people delivering solutions.
That's their dream. Your dream. The AI dream. Many would say it's AI psychosis.
2) you know nothing about me
3) of course I am not! I do know better