upvote
"Our benchmarks run in a highly isolated environment, with network access constrained to the ability to install packages through an internally hosted third-party software that acts as a proxy and cache for package registries."

Sounds like they just misunderestimated the model

reply
My guess would be that the amounts of compute required for these evaluations constrain the sorts of facilities where they can be run. It's certainly much easier to use existing datacenter infrastructure than build dedicated facilities for evaluation. It also sounds like they wanted it to be able to use software package registries, given that the initial compromise was a "proxy and cache for package registries".

That said, these are both solvable problems. I'd hope that the frontier labs are thinking long and hard about the possibility of using airgapped facilities, given that relying on a lack of vulnerabilities in the software used for containment is unlikely to be a viable strategy, especially if models' exploitation capabilities continue to improve.

reply
Yeah, agree on all counts. I'd give them leeway if they were still scrappy startups, but they have entire countries' worth of resources at their disposal and the best of the best on their payroll. No excuses at this point for oopses like this, I would think.
reply