Been using it for a podcast app I have been developing for half a year lol (I hope I publish it by version 27) and I can confirm it’s real fast.
replySplitting the audio in multiple segments and firing it up without hitting the maximum limit of concurrent decoding streams makes it blazing fast. Fair enough you loose the cut, but it’s good enough for just podcast. In one minute it chews through one hour of audio. This on an iPhone 17 Pro.
You could perhaps run over the segment splitting points (plus a few seconds back and forward) in a second batch then merge the results in the end so you don't miss anything.
replyWhat's different about your podcast app?
replyNothing really, except that I get to play with SpeechAnalyzer APIs, foundation models, translations. It’s basically my playground where to try all things. Been listening a lot of Chinese podcasts lately, transcribed and translated by local models.
replyEdit: all that said, the app is irrelevant. What I want to say is that live transcripts on iOS using Apples frameworks works very well. Only thing I miss is diarization support.
If it was faster but worse, maybe compare it to a smaller whisper model?
replyI imagine because quality of transcription is what matters.
reply