upvote
Open weight models are getting really good. Specko appears to be focussing on paid services which has its role to play but I have a benchmark in development for Open Weight models here if that is helpful: https://orcabot.com/benchmarks/open-weight-tts.

Still shoring up the details but you can try a sample of all the options and see how they compare in terms of model size, peak RSS, real time factor etc.

reply
Just canceled my WisprFlow subscription a few days ago to switch to a open source, free, local alternative. In my case handy.computer with the Cohere model.
reply
You mean handy.computer?
reply
Yup, my bad, fixed.
reply
You're not the customer. This is for people building products that support thousands of users.

Linux on desktop is great for you, but this is a tool for people delivering solutions.

reply
> You're not the customer. This is for people building products that support thousands of users.

That's their dream. Your dream. The AI dream. Many would say it's AI psychosis.

reply
1) what if I told you I can leverage local models and serve thousands of users?

2) you know nothing about me

3) of course I am not! I do know better

reply