It turns out Slack actually requires legal process or consent of parties to provide private messages to admins: https://slack.com/help/articles/204897248-Guide-to-Slack-imp...
But of course yes, another party could simply take a screenshot
If you talk shit about your superiors, it will get back to them. Same with "anonymous" surveys.
An inappropriate message may not be about something unsavory but about something private. Information about a contract which is not yet public. A discussion of a candidate who is then hired, and reads it. Etc.
Beyond that, the team are free to have private conversations between themselves. This is NOT something we log. At the end of the day, hiring good people and trusting them is important. The logic of making sure the AI does not leak those conversations also applies.
It is a new world, re:AI. It has its uses and things are changing at a rapid pace. It is not clear to be the protections we have implemented in todays paradigms are well implemented yet in the new AI world.
What a curious thing to say. My impression has been, if you put the accomplishments of computer science prior to 1990 against those subsequent, the prior would be more impressive, perhaps by a lot.