So the researchers might see something resembling a regular chat and not realize that every non-trivial prompt related to the problem spins up a swarm of agents and burns $50k in tokens.
That’s just speculation, but given the money involved in this stuff, it’s hard to imagine Anthropic is just sitting these mathematicians at a computer with a chat window and unlimited token budget and leaving them alone. They’ve probably sunk lots of engineering time into supporting this research.