The fact that they shipped it shows they don't know what they were doing, private or not.
replyThat’s a little unfair imo. Statistical models make mistakes and have failure modes which are difficult to predict.
replyWhen the bug popped up, turning the feature off was easier than retraining and redeploying.