Afaik it's used more for circumventing anti-bot measures and solving challenges than the download handling itself.
replyThis is accurate (maintainer of downstream project that depends on yt-dlp for archiving operations).
replyWhen downloading huge media files, the only speed you're being limited by is your bandwidth.
replyEverything else is completely negligible.