upvote
I’m very much surprised but also not. I recently gave Astra a 3D model file and asked Astra to build a viewer for it, and it figured out the data structures in no time. What I mean to say is that AI is insanely good at things that we humans would never do since the work would be too monotonous.

I wouldn’t mind if AI progress would stop right here and now, but I fear it will continue, and increase inequality in society which is contrary to what the CEOs say (as usual).

reply
I think the latest round of models is about to do to CAD the same thing that has been happening to development. I don't know if CAD designers have picked up on this. What happened to dev is probably going to happen to CAD designers soon. I've been having Opus 5.5 design parametric openscad models, and it can do some rather amazing work.
reply
Was Astra able to disclose its methodology for analyzing the data structures?
reply
Too much inequality in society is a mortal danger to 1%.

That’s the beauty of the democratic capitalism system. If a government isn’t totalitarian, it naturally seeks to preserve stability thus having to elevate common people, lest they would cease to form a civilized group or simply vote away the politicians.

99% rule the 1% through elections.

There is no better system of checks and balances where opposite engines of greed vector sum to faster and faster abundance for everyone.

reply
perfect playback! congratulations, you are a model citizen
reply
Is HN now against western capitalism? I'm confused...

That comment may have been overly preachy, tone deaf[0], and out of place, but it doesn't seem wrong, per se. Or am I missing something?

[0] e.g. elections themselves are so prone to manipulation (exhibit a: Dominion voting machines), previously trusted institutions now lack integrity, the insane power of well-funded NGO networks, etc.

reply
I would guess it seems very naïve to the overly cynical. And in 2026, being overly cynical is rather mainstream (understandably so).
reply
I fear western capitalism has lost its guide rails. We are seeing more and more centralization of wealth, along with unlimited election spending. Its a dark path.
reply
I mean there are more than enough countries on earth kinda proving you wrong, no?
reply
(This comment was written before your edit, so no longer valid! :D)
reply
They’ll just start bopping the 99% out the picture until the 1% is 51%.
reply
This does feel big, but the trillion-dollar question: is this trained by OpenAI and can other LLMs do it.

It’s no secret that these big labs see “recursive self improvement” as a primary goal. It seems natural that the models would be explicitly trained to excel at all sorts of ML related tasks as a result. Is this one of those tasks, or is this emergent?

reply
This seems emergent to me. LLMs are not trained directly on how to read weights, because humans do not understand raw weights, so there is no training data. They're trained on how to use the tools we have like writing python, examining training output and iterating, not writing whole weights from scratch.
reply
In cases where Astra succeeded, it succeeded using standard techniques also used by humans when they read and write neural network weights. It's a rare skill, mostly used for fun (e.g. https://blog.janestreet.com/can-you-reverse-engineer-our-neu... ) and basic research rather than profit, but Astra is big enough to have learned many rare skills.
reply
In a self-supervised setting you don't need ground truth data, as long as you have a proxy task that you can train on which forces the model to learn something useful. Like cutting out bits of images and telling the model to reconstruct the gaps (i.e. MAEs).

There are also techniques to watermark model weights to confirm what training data were used: https://arxiv.org/html/2512.17075 I'm not an expert in this domain, but it seems like there are lots of pieces that could be used to (a) train a model to infer whether some data were trained on and (b) train a model to understand which weights are relevant for a particular training task in a more explainable way than backprop/gradient descent.

reply
Humans don’t need to understand the data for models to train on it.

A large enough number of examples of “here are the model weights -> here’s what it does” will achieve this.

reply
There is a body of research on mechanistic interpretatibility that probably helped inform this behavior.
reply
I tried it in the Claude web version with Opus 5.5 Medium and it also identified Breakout, even though in one of its explanations it seems to have mixed up some indexes, but the overall reading of the weights was right.

That's also matching what I see when I work with Opus 5.5 to optimize models. It seems to understand what individual layers are for, and can thus sometimes suggest optimizations, where I as a layman would be completely clueless.

The latest models are performing amazingly. Because of this, I disagree with popular comments saying that eg. DeepSeek is good enough, AI-assisted development was where the real value was at, etc.

We see huge progress at the frontier, while the open competition is around GPT-5.5's level, and that model was released in April. Let's see how things develop in the future.

reply
> It seems natural that the models would be explicitly trained to excel at all sorts of ML related tasks as a result. Is this one of those tasks, or is this emergent?

Maybe there's some general capability, call it g, that can explain all the underlying capabilities and improvements, including on ML tasks? Huh, I am getting a bit of déjà vu here.

reply
This is just the model editing weights in the same way humans do when we jailbreak/ablate models. The method isn't novel, the interesting bit is that Astra will do it at all (I'd expect some safeguards in this area around jailbreaks)
reply
Was it "intuited" or empirical?
reply
How is it even possible though I can’t think of any reason why they would have the intuition.
reply
Could it be already baked into these models because they have already been trained on this task this way?
reply
My guess: There is a ton of data online of just plain weights laying around. No human would ever actually read it. LLM's read it all during training.
reply
But that would cover finite set of cases. I believe this result is more general.
reply
I mean it would make sense if the training using that data resulted in a general set of equations/patterns, it's still really surprising though...
reply
Based on our current understanding of LLM's, it shouldn't be.

This sort of throws a wrench in the whole "stochastic parrot" idea...

I am not surprised, though I expect many to be.

reply
Yes, this is hardly a shocker to anyone who used the latest models to convert/optimize AI models.

The other day I was thinking about the definition of AGI.

I was asking myself the question that when there is no form of data that I can think of throwing into Claude Code and have it not come up with some sort of intelligent answer about it, is that already general intelligence?

reply
IMO yes
reply
deleted
reply
See my other comment in this thread
reply