It seems to want an NVidia GPU. I didn't look closely to find out if it can run usably without one. For me, usable might mean 10% of realtime, i.e. an overnight run on my old x86 box for 1 hour of transcription. Of course faster is always nice. YMMV.
Bit unfortunate! Nemotron Streaming in Handy has basically solved dictation for me. It recognizes German mixed with English terms and brand names really well.
Select nemotron in the model selection
Also, there's no mention of Nemotron in that handy. Is that the same Handy GGP was talking about?
I’m still sad Voxtral 3 wasn’t made open source by Mistral.
e: also i'm testing it with a Q4 quant that might not be full accuracy
I was thinking of creating a local app that calls OpenAI’s VTT model. In my most recent evaluation, the OpenAI model was best for my use case. But is that indeed the case?