Probably a duplicate autopilot-like system that an AI controls. Flip a switch and controls revert back to the pilot. It may not even be a real switch, many planes disengage AP when you touch the controls.

I doubt AI will be doing dogfighting anytime soon, this is likely just an AI following predetermined routes and maneuvers and making the choice on how to accomplish them. The great thing about computers is that they can process inputs faster than humans.

The Tesla method! Disengage shortly before a crash. Now the human is responsible for it.

These are going to be experienced test pilots who are pretty good at actively managing autopilots and other automated systems. Plus they'll be backed up by telemetry to ground controllers. But ultimately the military is willing to accept some losses in order to advance key R&D programs.

Once the AI realizes it can do a maneuver the aircraft can survive but the "bossy meatbag" in the cockpit cannot...

This stuff actually gets tested, it's not your typical web framework junk.