upvote
IMO, his primary mistake was not turning the agent swarm on a proper research task that exhaustively determined whether it had been discovered or not.
reply
Well the Google SWE didn't make a mistake, the media made a mistake in misreporting it, and we at HN are making a mistake by giving it undue attention.

We are reading this article because it continues and amplifies the AI hype machine, and no other reason. If a motivated amateur had made the discovery through any other means, and motivated amateurs do things like this all the time, then it would never have gotten an article, never shown up on the HN feed.

reply
> never shown up on the HN feed.

While I appreciate and broadly agree with your bigger point, I'd argue this particular bit is a bit uncharitable. Articles about nerds doing interesting, unusual things do make the front page pretty often.

reply
They do but the point point is that this post made it because of the AI hype. Not the discovery itself which should grant more attention than that of a machine doing archeological "work" that happens to misinform.
reply
Huh? AI hype? Nothing in the article was hyped. The site was found independently from the other source, using Lidar data. Without AI it may take much longer to find this site. Now enthusiasts can use the same technique to find other sites, which may not yet be found. That's what makes it interesting.

At some point such discoveries won't cause as much stir, similar to how reusable rocket drew such fervent attention 10 years ago.

reply
> Now enthusiasts can use the same technique to find other sites, which may not yet be found. That's what makes it interesting.

This is the hype. The interesting thing is always in the future.

reply
You lost me.

> They turned the lidar strips (about 1,200 km² of jungle) into images, and 48 agents went through them one by one like very patient archaeologists, looking for pyramids, platforms, and plazas while filtering out natural hills, sinkholes, and roads. There was no special model or classifier involved: the agents literally looked at the pictures, following a precise guide.

That isn't in the future. Anyone can do that today, and with clever judgement and luck, can find some other sites today. Not in the future, although future will likely be easier.

He didn't say wait until next year for Gemini Dysprosium. That'd be hype.

reply
It's also the past - we as humans have been flying multi instrument platforms and crawling through traces for decades now.

Australia's been criss crossed with mag, gravity, lidar, gamma spectrometer, et al. since the 1970s and human operators have scrubbed glitches, filtered data, and composed maps leading to mineral discoveries, impact crater finds, unexpected structures found, etc.

Elsewhere, Angkor was scanned back in 2012 leading to revelations and new structures w/out the use of AI- https://www.siemreapbest.com/temples/blog/angkor-lidar-lost-...

reply
deleted
reply
I mean, if this were a true novelty, it would have been newsworthy regardless of AI involvement, but ya it does ride the hype train a bit
reply
I would be very surprised if LLMs were adequate for doing archaeological lit review. My experience is that you often find sites documented halfway through a stack of undigitized records in a physical archive somewhere, and it's usually a verbal description that's difficult to localize to a specific location. Heck, I've even contributed to the problem by finding new sites as we're packing up camp, when I didn't have time to properly document them outside field notes.
reply
my brother in law did a lot of research in paleontology as a grad student. He said a lot of fossil discoveries take place in basements or storage rooms. Unknown things that were collected but never documented.
reply
Why burn compute on that? He reached out to the Mexican Government and asked them if they knew about it - they said they didn't have it in the database. The discovery is relatively new (2025) so maybe sitting in a queue at the central office waiting to get into the system, not necessarily anyone's "mistake". On the contrary, the excitement gives visibility to the active research going on in this area, which is a positive outcome.
reply
And then another agent swarm to make sure that the research swarm didn't hallucinate any false positive matches!

LLMs are great, and they keep getting better, but I'm so tired of current shortcomings being blamed on the prompter "holding it wrong".

reply
You are supposed to use at least one LLM as judge for all output, in xhigh reasoning. Also important, is to run regular sample validations of output vs predefined input to ensure the model doesn't regress on your kind of data.

That process won't catch everything, but is worth it. that's how to "hold it right".

/s

reply
Yeah we devs call that deduplication.

Not so fable, this llm thing if it's missing a literal pyramid in the room

reply
Very reminiscent of my experience pointing persistent agents at computational physics problems. It can find amazing results and really surprise me, make a write up, and convince me it's a real discovery... until i tell it to do a literature search, and be meticulous. Then it comes back saying "prior art has reduced the novelty of the discovery", and finds papers explaining the discoveries very easily and intelligently.

Perhaps google SWE should have requested a literature search before publishing his results as novel

reply
A year or two ago, I wasted over a month on side projects that I thought were novel. Now, another LLM scrutinizes any idea in an area I don't know well ("I have just received this from a junior researcher on my team. Scrutinize it very critically. Don't hold back. This early stage is the best time for honest, harsh feedback. Don't forget to include the analysis of X, Y, Z in your report.").

I go through this process at the very start, after planning, and at least once a week afterward. With AI, the landscape can change dramatically during one week. I am not being hyperbolic.

reply
Asking an LLM for criticism is like asking a yes-man to punch you in the face. he'll always swing, but hitting a straw man he built himself.
reply
A fancy autocomplete still. Said with no intent to disparage. If the prior art hasn’t been pulled into the context window, it’s not surprising for the completion to not take it into consideration.
reply
Sometimes I feel like a fancy autocomplete myself.

Most LLMs these days can use tools (such as web searching), so depending on how strictly you define "autocomplete" this alone could disqualify it from being an autocomplete, fancy or otherwise.

reply
For sure yeah! What I’m pointing out is that I see people mistaking LLMs for “truth engines”, when they’re not. I find the “autocomplete” mental model really useful for when I work with LLMs myself. E.g., always keep in mind what’s in context, what’s not, where to get context.

Goes without saying - humans are no truth engines either lol.

reply
Yes, "predictors" or "completers" are a far more accurate metal model for what they actually do and it pays to understand how they "use tools" and what RL, SFT, etc. is and how it makes LLMs seem like much more than what they still, ultimately, are.

People latched onto the bs marketing terms like "thinking" way too easily. I don't know where all the classic hacker skepticism and desire to know how things actually work went the past four years.

reply
I enjoy the contrite rationalizations and turns of phrase LLMs use when encountering a discrepancy.

"Prior art has reduced the novelty of the discovery" is a great one

reply
Maybe LLMs are getting a little too good at emulating humans.
reply
It’s like a shell game. It’s likely overfitting on its training data.
reply
This is also a good example of the disconnect between what's valuable to scientists, and what members of the public think is valuable.

In this blog post, we have LLMs finding just one site in a 1,220 km^2 search area. And then sent an email to a government agency and got a polite "cool story bro" email in response. And that's probably as far as this will go because, in mesoamerica, "undocumented" sites are a dime a dozen.

Compare, for example, with this paper in which researchers found 6,764 sites in a search area only 1/10 as large: https://www.cambridge.org/core/journals/antiquity/article/ru... , and then proceeded to do real science with all that data.

And I have to point out, part of why they were about 5 orders of magnitude as effective at finding these sites is that they used much more sophisticated methods than what the LLM was able to come up with.

reply