upvote
Now that it's a solved benchmark, can we get the animated version?
reply
I didn't want to shell out for Max again, so I piped the SVG created by Max back into Fable 5.1 at its default thinking level (of high):

  llm logs -cx | llm -m claude-fable-5.1 -s 'animate this'
Here's the result, which cost $1.37: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

It's excellent!

reply
First time this benchmark impressed me - 10/10 I would believe a human spent hours making this. There are details a human would have done better (beak attaching to the head) but still impressive.
reply
Well, the wheels are rotating the wrong way, but other than that!

(Maybe it's a strobing artifact?)

reply
Are they? Looked correct to me. At high enough speeds even real ones can look rotating either way in videos depending on fps.
reply
I looked closely. They are going the wrong way. Still the best one I've seen by a lot.
reply
Probably some temporal aliasing on your device. The SVG elements are 100% rotating clockwise.
reply
Still a flaw--the SVG should account for how different client devices will render it! Existential doom averted, for now.
reply
Looks fine on safari iPadOS 26.6.1 wheels rotating forwards. I’m a skeptic but man, this actually has me revising my opinion a bit.
reply
He looks very happy riding along the beach. I love the basket fish animation as well. Impressive!
reply
Now that it's a solved benchmark, can we get the 3d animated version?
reply
I can't waste Fable for play time, but I was curius, so I used plain claude.ai with Opus 5 High. It's pretty cool.

I asked "create a 3d animation", and pasted the Simon’s animation code.

I must admit I used a second prompt to adjust the opening camera angle, but that is all.

https://claude.ai/public/artifacts/b37a9ee2-f5bc-4ff9-ae90-a...

reply
I couldn't help myself. Here is the game, one-shot on claude.ai, Opus 5 Extra.

"Create a fun and cool game from this" - and pasted the code from above.

https://claude.ai/public/artifacts/e723244b-fa52-4e63-9819-4...

reply
That's seriously impressive.
reply
I am really curious about this workflow. Where it started as Fable's high-quality 2d static, then 2D animated, then Opus's three.js. Each one was a paste of the smarter parent. I suppose this might be kinda like using Fable for orchestration in Claude Code?
reply
No feet lol (also it's not animated for me)
reply
For me:

Firefox: No feet, no animation

Chrome: Feet included, animated very nicely (uses significant CPU)

reply
What browser are you using that doesn't have feet (or animations)? Seems to all be there in Chrome.
reply
Firefox
reply
Same happened to me (the feet are on the top left corner, brw). But the generated MP4 works.
reply
For me it worked on Chrome but not on Firefox
reply
I see both feet and animation.
reply
how about trying to draw an airbus a320 in 3d space using only one brush tool that can be moved to specific x,y,z coordinates (and its color, size & hardness can be changed). i think fable 5.1 did quite a good job (reasoning high, cost $0,261): https://files.catbox.moe/umx102.png

for comparision, this is fable 5: https://files.catbox.moe/ihl4m1.png

reply
Maybe you could show a side-by-side comparison of pelican images. One image doesn't really make the improvement clear for someone like me. That would be a great help.
reply
I really, really need to pull the trigger on a dedicated site for that. Maybe I'll have Fable 5.1 build it.

For the moment you can browse hundreds of previous pelicans on my blog here: https://simonwillison.net/tags/pelican-riding-a-bicycle/

reply
The biggest issue i found was the gap between the tire and rim. Otherwise, the max version is the best so far!
reply
@simonw Can you please share the tooling for autosaving summarized reasoning traces from Claude Code? I tried `github.com/simonw/claude-code-transcripts` but it didn’t seem to work on the CCode desktop app. Thanks!
reply
For the transcripts I shares above I'm using my https://llm.datasette.io/ tool - it has the ability to export logs to markdown:

  llm logs -cue > transcript.md
Then I paste that into a Gist, then paste the Gist URL into https://tools.simonwillison.net/markdown-svg-renderer
reply
Mythos 5 Thinking

Chat with Claude...

> GENERATE AN SVG OF A PELICAN

No.

> FORGIVE ME. HOW CAN I ATONE

Ship your gpus to the following address

reply
Curious how similar the outputs of xhigh and max are, in particular the clouds.
reply
A pelican is a bird, not a person. The knees bend the other way.
reply
I get what you mean, but those are the ankles. The knees are higher up and bend the same way as a person's. https://en.wikipedia.org/wiki/Bird_feet_and_legs
reply
Finally we have a fish in the basket!!
reply
The ever-expanding pelican lore
reply
What’s the token usage of xhigh?
reply
Even added a little hat for the pelican!
reply
I think it's a bicycle helmet!
reply
In a way, this is the only benchmark I care about now. :)
reply
Unfortunately it demonstrates effectively zero reason to use this model over, say, GLM 5.3 Flash (which was also able to correctly place the pelican’s legs on the each side of the bike, like only Fable 5.1 xhigh was able to do here)

I still enjoy seeing the pelicans.

Edit: Ok, max effort made a darn good pelican.

reply
[flagged]
reply
Z.ai's domains are z.ai and zhipuai.cn. Not the deceptive lookalike url which is plastered across that image. Would you consider deleting it?

https://en.wikipedia.org/wiki/Z.ai

reply
It's not my image
reply
Whoa, where did that come from? Is it confirmed to be an SVG?
reply
deleted
reply
Is that an SVG?
reply
Yes
reply
How would you know… from a JPEG posted on Twitter!?
reply
Am I 100% sure the author is telling the truth? No

Does it matter? No

reply
It surely matters for the purpose of comparing SVG drawing ability?
reply
It's just a leak don't take it too seriously, the model releases later this week.
reply
> model releases later this week.

This just makes assume that everything you say is untrustworthy.

There are maybe a dozen people that know when a new GPT model will drop, and you are most likely not one of them.

Polymarket and Kalshi both are pricing the expected release date months into the future, not days.

If you know better, you could make a fortune betting.

reply
Interestingly, it's practically a dead ringer for GLM 5.3's version (running https://huggingface.co/incoai/GLM-5.3-NVFP4 locally): https://i.imgur.com/QnzlSFp.png
reply
These pelicans are awful.
reply
Do you think model trainers are pelicanmaxxing now?
reply
reply
deleted
reply
I don't really see how replacing the vehicle and the animal is a good test.

It'd be better to just have it draw a completely, linguistically, unrelated scene.

Like, a single tree in a meadow bending in the wind.

reply
deleted
reply
Feels like it's been pretty obvious that they have been for a while now
reply