i've seen it play minecraft as well, what im not sure here is what is the thing that produces the JSON and keeps track of the objects

can jev play battlefield six for example

BTW it was not multi model playing doom, it was passing structured input and getting structured output. Its not what I thought: frames of video passed and real time game play.