It's a quick proof of concept of computer use powered by Jev, a new general-purpose classifier model. Here it takes the description of the interface (it can't do images yet) and outputs commands. It's faster and many times cheaper than using frontier generative models like GPT to do the same.

Jev docs gives a good explanation https://docs.typesafe.ai/concepts/system-one

Also see recent discussion https://news.ycombinator.com/item?id=49717558#49718350