Agree - it's annoying. rclone to the rescue. Requires choosing Google Drive as the destination and then downloading with rclone to your computer. It's the closest to sane I've found.

https://metadatafixer.com/learn/how-to-download-google-takeo...