- parakeet usually runs on Bfloat16. NPU doesn't support that
- CPU is not as fast as the NPU for these ops on A-series, and even on modern CPUs, there's a latency delay
- Parakeet latency is fine but "fine" may not be good enough for Apple's UX team.
- CPU increases power consumption over dedicated float blocks
So I would say that Parakeet was a non-option for Apple to ship, although it should be in the benchmarks anyways!
https://github.com/FluidInference/FluidAudio/pull/507
That means one hour of audio transcribed in 11.25 and 12.75 seconds.
The Inscribe post doesn't give a speed factor for SpeechAnalyzer. However, this Argmax blog post reports 70:
https://www.argmaxinc.com/blog/apple-and-argmax
Based on that, FluidAudio is ~4.6x and ~4.0x faster.