> I read somewhere it comes from training on YouTube audio

Does it also insert "please like & subscribe?"

Ha, I also have this happen all the time in response to mouse clicks. When playing with Apple Foundation Models + Whisper I noticed that it happens so often that I had to explicitly filter this out before acting on transcriptions.