I don't think this small amount generalization to other animals and vehicles is strong evidence they haven't trained on this, either directly or more generally.
replyHonest question how could they possibly train on this as there are no good SVG pelicans to train off right? So they’re just training off a bunch of bad ones which should lead to just bad pelicans, but the pelicans are getting better.
replyThere's that version of the argument version, but there's also the softer version: that there used to be no training material of illustrated pelicans on bicycles, but now you have actual artistically talented individuals drawing it and that could improve the performance even though the AI labs are sucking it up no differently than everything else.
replyThis post proves that hasn't happened yet, either. Although maybe the bad results posted online are being trained on and that explains the UNDER performance.