upvote
I’ve been paying attention at this exact detail.

Misplaced legs clearly indicate lack is spatial reasoning - the llm can reason about verbal idea of a bicycle but not about the actual object. The fact that this model got it correct gives me a pause. Did they figure out spatial reasoning? Or did this complain trickle down to the training set?

reply
6 Astra Max is the only other model I’ve seen get this right.
reply