It's pretty trivial to just open it up and disconnect the speaker too. I took one apart to make a custom wallet card out of it and broke the speaker in doing so; the rest of it worked perfectly fine (though obviously the warning would still work).

They're also, as it turns out, vulnerable to a drillbit

Isn't airtags completely and utterly broken, or has anything changed?