I like how they also did a frog on a penny-farthing and a giraffe driving a tiny car and an ostrich on roller skates and a turtle kickflipping a skateboard and a dachshund driving a stretch limousine.
replyOk Google what are some other examples like a pelican riding a bicycle
replyreminds me of andor, luthen, positive reinforcing wasting time of emperor
replyAnimated SVG is huge. People in different professions are worrying to different degrees in terms of being replaced by ML, but this one is huge with regards to digital art.
replyyeah, complex SVG's are so much more bandwidth, computation and energy efficient than raster images - up to a point! but in general use we are not at that point and there's so much more we can do with it
replyI've been meaning to let coding agents take a stab at using the lottie library https://github.com/airbnb/lottie-web to supercharge the user experience without needing to make it a full time job
Can't wait until they finally get to real world CAD
replyThere's a CAD example in that same thread: https://x.com/JeffDean/status/2024528776856817813
replyHe's svg-mogging
replySo let's put things we're interested in in the benchmarks.
replyI'm not against pelicans!
I think the reason the pelican example is great is because it's bizarre enough that it's unlikely that to appear in the training as one unified picture.
replyIf we picked something more common, like say, a hot dog with toppings, then the training contamination is much harder to control.
I think it's now part of their training though, thanks to Simon constantly testing every new model against it, and sharing his results publicly.
replyThere's a specific term for this in education and applied linguistics: the washback effect.
It's the most common SVG test, it's the equivalent of Will Smith eating spaghettis, so obviously they benchmax toward it
replyYou don't have to benchmax everything, just the benchmarks in the right social circles
replyIt if funny to think that Jeff Dean personally worked to optimize the pelican riding a bike benchmark.
reply