https://en.wikipedia.org/wiki/ELIZA_effect
It turns out the limiting factor isn't how sophisticated algorithms are, it's how gullible humans are.
No AI would pass this test with experienced judges.
Edit: Also doesn't say anything about who the human test subject is
You can always say “oh well these judges don’t have the experience to catch this type of AI.
The fact that you have to insert this qualifier, to ensure you always have a way to discredit the test, pretty much shows to me that we’re beyond it.
https://www.writingsbyraykurzweil.com/a-wager-on-the-turing-...
Those rules are fairly reasonable, at least as a start.
Though we're pretty good at sizing up a person's emotional balance/maturity and competence at familiar tasks. So maybe have an old blacksmith watch the AI/robot interact with horse owners for a while, then shoe their horses, and see how well it does.
https://commission.europa.eu/news-and-media/news/safer-and-m...
In contrast, humans tend to paste me the same barely-relevant macro over and over, no matter how much time I spend explaining my issue.
https://www.psychologytoday.com/ca/blog/the-digital-self/202...
And the "popularized" version is faulty also since it uses an ideal, abstract human judge (like the "spheroidal economic agent").
But if you want to add declinations to the said popularized image of the Turing test, you may add Maxim Lott's IQ tests at trackingai.org . Between the end of 2024 and the beginning of 2025 LLMs reached an equivalent IQ of 100, for example.
I kinda have to link it now, so uhh here's a random PDF: https://www.hec.edu/sites/default/files/documents/Computing%...
ELIZA beat the Turing test and then everyone forgot about it. Humans are just really terrible at recognising robots.
I think there are elements showing lowering of performance and expectation.
I've tried [1] and I almost 100% detect which is the AI. I really want to convince myself I have failed, does anyone know of a better site/resource for this?
I know it might be moving goalposts but I would consider AI to have passed in a well and truly undisputed manner when [2] is resolved.
But in a more practical sense, if AI can impersonate humans so well today then why are state of the art frontier models so obviously AI when they create PRs, commit messages, documentation, etc. Are the companies deliberately making them unnatural?
[2] https://www.metaculus.com/questions/11861/date-when-ai-passe...
Not sure where you're quoting from but if it's the metaculus question comments, many of them are from 2023. The consensus is it will resolve in 2029. I believe it will not resolve before 2035.