(unloading to the NPU is where the edge is)
https://huggingface.co/FluidInference/parakeet-tdt-0.6b-v2-c...
https://github.com/FluidInference/FluidAudio
The devs are responsive and active and nice on their discord too. You’ll find discussions on all the latest whizbangs with VAD, TTS, EOU etc