The “make it so the model can't misbehave” part is interesting. Maybe the goal isn't to make the model perfectly aligned, but to make misalignment have a very small blast radius. That feels like a more achievable engineering problem.

> Make it so the model can't misbehave.

How do you figure? I haven't met anyone who thinks that's possible. It seems clear to me that it is not possible.