upvote
6-luna is at the pareto for most of the tasks! I dont know how they make money here but its insane value from a closed source model. I'd go further and say it makes no sense (privacy, sovereignty etc aside) to use many other models as its not only expensive but also many providers don't have that much GPUs to serve at a significant volume. https://openrouter.ai/rankings?view=month#top-models 5.6 luna is already the most used model this month.
reply
My OpenCode Go stats for the last 30d:

Cached Read: ~6,500M

Input: ~150M

Output: ~20M

Approx $40 worth of usage across DeepSeek V4 Flash + MuseSpark Contributor 1.3. And a bit of both the GLM models. This is covered in a $10 subscription.

If I were to use Luna's API pricing:

$0.02 x 6,500 = $130

$0.20 x 150 = $30

$1.20 x 20 = $24

So $184. And this is assuming smaller coding sessions (<272K) beyond which Luna pricing doubles.

--

Cost wise, these models are nice for small stuff. Translations etc. Any model that does not provide multiple Mtoks of cached reads per cent is not very useful to me for coding workflows.

reply
How long can OpenCode bleed for?
reply
Are they bleeding? Their multipliers seem to be reasonable. They are not offering $60 worth of usage for $10 on every model, only some. In the case of the expensive ones, it is only $15.

Given how subscription models work (not every one uses every last $ of their plan), they should achieve breakeven soon enough I guess.

reply
They already stopped. That's why the service quality declined.
reply
What did you notice?
reply

    I dont know how they make money here
Well, here's the neat thing: they don't!

Snark aside, Luna 5.6 was (is) an incredible game-changer.

reply
> Well, here's the neat thing: they don't!

perhaps it then does mean - squeeze as much as you can get off this actual free usage.

reply
"We lose money on ever sale, but we plan to make it up in volume"
reply
6-luna is no improvement over 5.6, merely a price cut.

And info from the help page with message limits suggests the 50% price cut does not apply to the subscription, where they applied only a 1/3 price cut instead.

I'm not thrilled with this release.

Opus 5.5, which matches GPT-6 Astra performance at a cheaper price, is much more interesting.

reply
Can't agree more. Between 5.6 Luna and Gemini 3.8 flash I'm so happy for the value I'm getting for my dollar (subscription pricing not API pricing) :)
reply
Gemini 3.8 Flash looks like its better than v7 Luna/Sol on DeepSWE v1.1 while at $0.75 per million input tokens and $3.75 per million output tokens. Luna is much cheaper, but Flash has nearly Astra's performance for under the price of Sol ($2/$10).
reply
Flash thinks much more so it’s pretty much line with Sol for performance. That said I like flash coding style much more than OpenAi models.
reply
out of curiosity, what type of code/language do you usually use flash to write?
reply
I use it for golang, and it is fantastic. Incredibly fast. It seems the llm and I “understand” each other. I have to be less careful in my exact phrasing. It kind of just does what I want and expect.

When I ask for an explanation it adds the right amount of detail. Of course, some of the material is new to me so subtle errors are hard to spot. But at least I’ve caught Terra and Sol on inconsistent messaging.

Also I’ve found 3.8 flash to circle back to root issues even at the conceptual level like problem fit and conceptual solution direction or architecture when I wasn’t achieving my goals. It flat out said I was attempting to use the wrong tool. Whereas Sol and Astra kept rabbit holing and looking for tiny implementation errors. Even after prompting them specifically to look at it broader.

reply
what harness or plan are you using 3.8 flash with?
reply
TBH: I really like how fast 3.8 Flash is... Once I have clear plan, I feel quite confident in delegating large parts of implementation to Flash and Luna
reply
look at token use, 3.8 flash is a huge token hog compared to openai models
reply
Gemini 3.8 Flash and 3.1 Pro are pure rubbish. Very little thinking, mediocre and usually incorrect results. They cannot be compared to frontier models.
reply
This is my experience as well. I am surprised that lot of people find it much better than Luna.
reply
How does 6-Luna xhigh compare to 6-Sol medium? Or more broadly newer/bigger model with lower effort vs older/smaller higher effort?
reply
Read the link! It's in there.
reply
> I dont know how they make money here

By raising it from investors.

reply
To whom they promise the Sun, the Moon, and the Stars. Roflmao. Whatever the merits of the underlying technology, the business model is pure hucksterism.
reply
MiMo 2.6 Pro is at the Pareto frontier (the one where you only need 20% of the smarts for 80% of the tasks) according to Artificial Analysis, nicely filling in as a substitute for a hypothetical 'GPT-6 Terra' (which doesn't exist as far as we know). That's pretty darn impressive from an open model.
reply
That's not what the Pareto frontier is; you're mixing up Pareto frontier with Pareto principle.

https://en.wikipedia.org/wiki/Pareto_front

https://en.wikipedia.org/wiki/Pareto_principle

reply
Despite the error in the parenthesis, it's exactly what he says: https://artificialanalysis.ai/?intelligence-category=text-on...
reply
I was just responding to the error in the parenthesis.
reply
Offering Luna for cheap is like restaurants giving you free bread and water. They're pretty sure that you're going to end up eating the expensive stuff on the menu.
reply
Note that to sit at a restaurant you're obliged to order something, though. Here there is no obligation to go beyond the model you choose.
reply
perhaps they use this as the carrot to get you locked into their monthly plan over anthropic's.
reply
works great until they raise prices.
reply
There's no difficulty in cancelling.
reply
> I dont know how they make money here

I assume it's a subsidy to get more training data.

EDIT: Okay downvoters, what's your take on why they're giving away Luna for so cheap?

reply
Simon, love your work, one piece of minor feedback for the individual model pages is to make the font of the model name potentially bigger than (and above) the conversation id (which means nothing to the audience) "2026-09-22T18:28:00 conversation: 01m355zvyw8946qyraa8zpz6h9 id: 01m355zvyx47zxx5c6q6b3fg0m#".

I had all the tabs open individually and harder to scan which model is which... otherwise keep up the great work! I like the grid view a lot. (Also the pages have no OG images set, which impacts what the link looks like shared)...

reply
That's a good idea. It's the default output for my `llm logs` command, but that header could at least show the model ID.

OG images will require me to move away from publishing in a Gist and linking to from a JavaScript page that loads the Gist. Probably worthwhile though.

reply
I think you can make it work without leaving Gists by using a Cloudflare Worker as a workaround. The Worker sits in front of the renderer page and adds the og tags to the HTML before it's sent out. You'd also need to turn the SVGs in the Gist into a PNG for the og:image, and decide if you want a grid or just one image, any text formatting, and how long to cache...

I got it working in a quick local test (grid of all the reasoning efforts, cached per Gist, loads from the raw Gist URL so it doesn't hit the GitHub API rate limit).

Code + prompt + notes here: https://gist.github.com/matznerd/ece297107bd99ac028c7962c217...

Basic concept is to:

1. Put a Worker on the /markdown-svg-renderer route. Normal visitors get your page exactly as it is now.

2. When a link has ?url=<gist>, the Worker reads the Gist and adds og:title, og:description and og:image to the page's HTML. Link previewers like Slack and iMessage don't run JS, so this is the only way they see them.

3. og:image points to a second Worker URL (og.png?url=<gist>). It takes the SVGs from the Gist, puts them in a grid, and converts it to a PNG, since previewers won't show SVGs.

4. Both results get cached per Gist, so each Gist is only fetched and rendered once, even with a lot of traffic.

Things to customize:

- Title and description (mine: "gpt-6-luna SVG of a pelican riding a bicycle" / "6 runs, reasoning effort none to max")

- Grid of all runs vs just one image, plus layout, labels and font

- How long to cache (I used a day, but edited Gists keep the old preview until it expires)

reply
Here are some somehow standardized pelican tests but for 3d scenes in threejs at threejseval.com

Luna 6 High: https://threejseval.com/models/gpt-6-luna-high

Sol 6 High: https://threejseval.com/models/gpt-6-sol-high

You can compare any other model on the same prompt. Gallery unlocks after 4 votes: https://threejseval.com

reply
I find it very interesting that for both these models we such a clear progression of better images with higher thinking levels from 'hardly useful' to 'pretty nice'. I feel on many other models low and max are much closer.
reply
Not that this benchmark is super relevant anymore but these look worse than I expected.
reply
Yeah, it's interesting how much worse they are than the Astra pelicans. I think that reflects a tiny bit of genuine value still left in the benchmark, to be honest.
reply
To me the main upshot of this benchmark is precisely that the pelicans still usually look a bit wonky. It's bizarre, since this definitely has a good solution, but it's in line with my experience that memorization of the training set just... isn't happening very much? As in, whether a model fails or not doesn't have much to do with whether that exact question was likely posed many times before.
reply
Tons of value left, especially for open source models. I would say the benchmark is yet to be truly saturated (just look at the legs and seat to see what I am talking about) and I always look forward to seeing them. Thank you!
reply
It would be extremely funny if the explosion in SVG generation capability in particular was a result of this benchmark
reply
It's surprising but MiMo V2.6 Pro performs better and is cheaper than GPT 6 Sol on my benchmark[1]. Open weight models are really snapping at the heels of the major western models.

1 - https://bench.killswitch-lang.org

reply
Wow I cannot believe Luna is getting even cheaper. IMO this is the model that is going to change the world.

Everyone said tokens were too expensive but these are getting close to free while still having fantastic performance.

reply
> GPT-6 Luna being half the price of GPT-5.6 Luna is a really big deal.

Is it? It was already too cheap to meter for me. Luna 6 is actually worse on some benchmarks than 5.6. I’d have loved improved performance for 2x the price than ~equal performance for 0.5x the price.

reply
I’ve been doing really heavy text analysis work with LLMs where false negatives/misses are important to minimize and my god did I hit cost thresholds quickly with 5.6 Luna — it was the first time I felt motivated to seriously work with local open models, even if inference was degraded for the task. Cheaper and much better inference now brings me back to the closed models for better or worse.
reply
5.6 Luna was already discounted at half the price on OpenRouter. Looks like they made it permanent.
reply
Hopefully Terra 6 slots somewhat nicely into this space.
reply
Yes, I am mildly disappointed with these releases.

I expected a Fable 5 -> Opus 5 situation, where GPT 6 Sol would perform on par with GPT 6 Astra.

Instead it's more like a price cut on GPT 5.6 Sol, and I'll have to stick with Astra for my work.

The only thing I can hope for is that more users switching to the GPT 6 Sol model frees capacity, allowing OpenAI to hand out some usage resets.

reply
What's with the radial spokes? When are we gonna start seeing proper cross lacing?
reply
And how about that head tube angle?
reply
How come the pelicans get older with more reasoning? Is GPT 6 taunting us with our mortality?
reply
Many of them still get the layers wrong.

They put both legs on the same side of the bike.

Even Astra max which actually put one leg on each side of the bike still somehow messed it up because when it added the bike chain, it put the left leg between the bike chain and the frame.

reply
What I overwhelmingly love about that Pelican grid is the two best ones, they've put a neck scarf on to show speed and wind.
reply
I've been sharing that pelican grid in my circles a whole bunch, it's great! I think only one data point is missing, generation speed. Would be interesting to see how the reasoning level/token counts relate to speed.
reply
The sol max looks like it's absolutely ripped for some reason
reply
He’s been biking a lot
reply
he's been cycling a lot
reply
deleted
reply
It's funny that even Astra doesn't know you ride a bike by straddling it between your legs. (EDIT: Oh, I guess Max gets the occlusion. But it doesn't realize it has to pick direction the knee bends in.)
reply
> Error: Gist API returned 403

Is what I'm getting on the top two links.

reply
looks like they're positioning luna to tackle the low-cost cn models
reply
> half the price of GPT-5.6 Luna

Half the price when it launched, or after the price dropped by 75%?

reply
After the price drop. GPT-6 Luna does not perform better than 5.6, so they can't raise the price.
reply
Is GPT-6 50% cheaper?

> GPT‑6 Luna vs. GPT‑5.6 Luna | $0.20 → $0.10 | $1.20 → $0.50 | 50% cheaper

I can read it as follows (below), meaning that GPT-5.6 is 50% cheaper.

- GPT-6 = $0.20

- GPT-5.6 = $0.10

reply
The table on https://developers.openai.com/api/docs/pricing is more readable:

  +--------------+-------+--------------+--------------+--------+
  | Model        | Input | Cached input | Cache writes | Output |
  +--------------+-------+--------------+--------------+--------+
  | gpt-6-luna   | $0.10 | $0.01        | $0.125       | $0.50  |
  | gpt-5.6-luna | $0.20 | $0.02        | $0.25        | $1.20  |
  +--------------+-------+--------------+--------------+--------+
reply
Yeah, how they put, is confusing to me, they should have put that table instead of what they have right now in the article.
reply
Yes, GPT-6 Luna is 50%-58% cheaper than GPT-5.6 Luna. (I think the blog text and graphs make it pretty clear.)
reply
Yeah, but it confuses me, I read left to right, so if they put GPT-6 and $0.20 first, I would assume that's the new pricing, they should make it clear, not confusing.
reply
If you're happy with letting Meta train on you, Muse Spark 1.3 Contributor pricing is a much better deal than Luna
reply
deleted
reply
> GPT-6 Luna being half the price of GPT-5.6 Luna is a really big deal.

good god

reply
That GPT-6 Sol max pelican looks… so old and depressed.
reply
Is Luna (on "low" thinking) the first left handed model?
reply
out of curiosity, do you retry the same model multiple times to see the range of output it comes up with? or is it purely a 1-shot test
reply
Isn't everyone pelican-maxxing these days?
reply
He also blogged why he thinks it's still useful
reply
When the Astra one was last time run? It's probably better to run these 2-4 weeks after release when models get nerfed to get idea of performance closer to what it is.
reply
How do you know they are nerfed, and how do you know the timeframes?
reply
Do you have a page showing all the pelicans you've ever created? Could be fun to browse - kinda like https://progress.openai.com/ but visual. (It's a shame they don't keep it updated)

I'm so tired of looking at benchmarks. I always look fwd to the pelicans.

reply
My new sub-benchmark is which combinations achieve the hook at the end of the upper beak. Right now just 4: Astra Max, XHigh and Medium; GPT 6 Sol Max
reply
What I like about the grid of SVGs is from I can see that Astra high seems to yield similar quality and price to Sol 6 max.

And Astra medium seems to yield similar or better quality for the same price as Sol 6 xhigh.

reply
Looking at this, AI still has a long way to go. In Sol Max, the pelican's legs are missing on one side—how can one side have two pedals and two legs...
reply
And the bicycles have weird dimensions -- extremely slack head tube angle, handlebars in the wrong orientation, etc.
reply
That's just foreshadowing the next generation of 32" all-mountain frames.
reply
Out of all of the benchmarks out there, pelican bicycle bench is the only one I care about. Thank you Simon.
reply