upvote

points

by thevinter16 hours ago |
comments
upvoteby lehmacdj16 hours ago|
[-]
So do you think there will be a better image model in a year?
reply
upvoteby throw31082215 hours ago|
parent|
next
[-]
I'll bite: no I don't think so. If the examples are not cherry-picked and by "image model" we mean just the ability to generate pictures, this looks like parity with human excellence, there isn't much space for further improvement. The images don't just look real, they look tasteful- the model is not just generating a credible image, it's generating one that shows the talent of a good photographer/ designer/ artist.
reply
upvoteby Vachyas15 hours ago|
parent|
prev|
[-]
I'm honestly unsure what could be improved at this point.

Consistency? So it fails less often?

Based on the released images, (especially the one "screenshot" of the Mac desktop) I feel like the best images from this model are so visually flawless that the only way to tell they're fake is by reasoning about the content of the image itself (ex. "Apple never made a red iPhone 15, so this image is probably fake" or "Costco prices never end in .96 so this image is probably fake")

reply
upvoteby thevinter15 hours ago|
parent|
next
[-]
There is definitely room for improvement: https://gist.github.com/simonw/88eecc65698a725d8a9c1c918478a...

Especially when it comes to detailed outputs or non-standard prompts.

I do believe it will get even better - not sure it will happen within a year but I wouldn't be incredibly surprised if it did.

reply
upvoteby vunderba15 hours ago|
parent|
next
[-]
Yep. “Where’s Waldo” has been a classic challenge for generative models for a while because it requires understanding the entire concept (there’s only one Waldo), while also holding up to scrutiny when you examine any individual, ordinary figure.

I experimented with the concept of procedural generation of Waldo-style scavenger images with Flux models with rather disappointing results. (unsurprisingly).

reply
upvoteby Vachyas13 hours ago|
parent|
prev|
next
[-]
That's a good example, actually.

If you asked me what I expected, since this one has "thinking", it'd be that it would've thought to do something like generate the image without Waldo first, then insert Waldo somewhere into that image as an "edit"

reply
upvoteby throw31082215 hours ago|
parent|
prev|
[-]
I wonder if at this point you could just ask the agent to iteratively refine the image in smaller portions.
reply
upvoteby RobinL15 hours ago|
parent|
prev|
next
[-]
I'm been impressed when testing this model today, but it still can't consistently adhere to the following prompt: make me an image of a pizza split into 10 equal slices with space in between the them, to help teach fractions to a child.

It doesn't reliably give you 10 slices, even if you ask it to number them. None of the frontier models seem to be able to get this right

reply
upvoteby jinushaun15 hours ago|
parent|
prev|
next
[-]
Cost? Speed?
reply
upvoteby vunderba10 hours ago|
parent|
prev|
[-]
> I'm honestly unsure what could be improved at this point.

That's because you're focusing a little bit too much on visual fidelity. It's still relatively trivial to create a moderately complex prompt and have it fail miserably.

Even SOTA models only scored a 12 out of 15 on my benchmarks, and that was without me deliberately trying to "flex" to break the model.

Here's one I just came up with:

  A Mercator projection of earth where the land/oceans are inverted. (aka land = ocean, and oceans = land)
reply