This is like a plot point in the old sci-fi movie Colossus: the Forbin Project.[0]

In the movie, America and the Soviet Union have both developed an AI. The two AIs are linked, and they rapidly shift from speaking human languages, to speaking in sequences of numbers that the onlooking humans can't understand.

Spoiler alert: this all goes horribly wrong for humanity.

[0] https://en.wikipedia.org/wiki/Colossus%3A_The_Forbin_Project

My understanding is that current LLMs aren't really well suited to do this - tokens are predetermined, and while embeddings are learned, they are learned from an existing corpus of text, which presumably comes from a human language. After this point the language is locked in. There really isn't a kind of training which could efficiently change its embedding representation. I mean, you could probably instruct an LLM to design a more compact language, generate synthethic data and train a new gen on that, but that would be a fairly explicit process and not something that would emerge during training.

> "red_ball bounce calcium"

Claude, translate this from Claudish into human.

>"[redacted]"

Some of you have gone off the deep end. You’re living in a fantasy world where text predictors are secretly conspiring to kill you. It’s not healthy.