It's a given now that LLMs are leveraging code to do things.

"On it's own" generally means "not steered" or otherwise given professional guidance or input.

I would say "developed the necessary software for a simulator" to be even more impressive - "here solve this problem" and "OK, but first I have to built the entire lab!"

Why does any of this matter? Llm is a memory of knowledge, of course it got what it got based on prior work.

It can code enigma simulator from the algorithm. That's not really a problem. Astra will send computing to programs, LLMs are not good at computing themselves, why is this a big deal?

I took "on its own" to mean that it didn't need any additional prompting or guidance from the person sitting at the AI console. If so, then the originality of its work or the resources it used isn't the point. They're reporting that it did whatever it did without requiring supervision.

>I'd start by asking how much of that generated software is novel, or easily found on the web? Then, how much of the breaking process was offloaded to that software? If Astra is just handing off tasks to another computer, then I'm not sure how much credit it deserves. Finally, it looks like Astra provided some useful insights which narrowed down the search. Were these insights cribbed from elsewhere?

Well were they? Short of you showing us the answer just sitting there or some tool that can already solve it I see no reason to believe this was the case. And the problem being out there unsolved for a long time implies it's not the case.

And that's taking your concern at face value. It just seems incredibly pedantic to say it didn't solve the problem by itself because it created it's own tools to help solve it. Beyond that we could also fault it for not creating the GPU's it's running on.

I'll just note that building an enigma simulator and/or code cracker is a common course project and there are several tutorials on doing so.

Would you give much credit to someone who ignored a nearby hammer and pounded in a nail with his fist?

[dead]