Yes, this is a fair point. I agree that orbital mechanics is trivially easy compared to everything else. The chances of a math mistake in particular are null, these trajectories have all been calculated years in advance.
The moon's gravity turns out to be "lumpy" because its density is not constant. This was detected by the Apollo missions and caused them to make errors in orbit calculations. This source of error could have influenced the flyby.