ARC-AGI-3 scoring is constructed in a weird nonlinear way (the level score is the square of the ratio between the AI's number of moves and the human median) so this kind of discontinuous jump is to be expected.

They used a custom harness. It's not a one-to-one comparison.

my first suspicion is gaming - but i have no idea honestly