upvote
This might be in other pelicans, but 6.2 Sol/Astra is the first time I'm noticing a model shade the leg further in the frame darker to mimic depth (or a shadow).

It's also interesting you can clearly tell 6.2 Astra does a much better job of the above. 6.2 Sol attempts it at higher reasoning levels, but it's crude in comparison.

I wonder if it comes from the (seemingly) recent inclusion of 3D environments in training data.

reply
The emergence of the beach setting and the scarf is interesting.
reply
Do we know why they always end with a scarf?
reply
They all seem very good, with a lot of attention in detail ! Thx for the Pelicans!
reply
What's with everyone saying these Pelicans are great?

These are some of the worst regressions that I've seen in a while.

Pay close attention to the stacking layers around the feet, pedals (sometimes there aren't even two pedals), wheel, and two legs. Some pretty obvious mistakes in most if not all of these...

Edit: And what's up with the single arm on the two highest Astra images?

edit2: really? I'm getting downvoted because people don't like that I pointed out a mistake in a Pelican svg? Is that where we're at?

reply
I have to agree, those results are surprisingly bad and I am not seeing an improvement.

For sol 6.2, some of them are slightly better at higher cost, some of them are way worse and only slightly cheaper (but comparable to terra in quality while being more expensive).

I guess we'll see as more information comes out, but so far not looking good.

reply
The highest Astra images give the pelicans wings instead of arms, which does seem like a valid interpretation.
reply
any index link for all ur pelicans i want to see fable and opus
reply
Sol 6.2 max is still failing on pelican benchmark. Left leg is jammed in chain.

Astra 6.2 max did a similar mistake on the left bicycle pedal.

reply
But Astra 6.2 low and medium didn't make this mistake.
reply
Wow the yellow is leaking into their llms too.
reply
I'm not sure if this is a useful benchmark any longer
reply
They're extremely useful. In fact, I refuse to make infrastructure decisions in a pelican-blind environment.
reply
Are you getting any signal out of this anymore? All I can see is "good pelican" and "dogshit pelican". These ones look pretty good.
reply
I do. 6.2 Sol xhigh and max show the results comparable to Astra 6 max, and Astra 6.2 only shows any improvement on "max" reasoning effort level.
reply
You're kidding right?

These are some of the worst pelicans I've seen in a while.

Pay attention to the stacking layers near the legs. Sol literally never got it right, and Astra regressed on it multiple times...

Also what is that bending bar from Astra?

reply
still the best benchmark! thanks
reply