This likely means those consuming the outputs of Mechanical Turk don't have a good way to measure the value (aka quality) of the outputs.
replyIf they did - then they shouldn't care whether it's a human or a LLM. And if it's a LLM - then the cost will roughly correlate to the MIN(cost of the LLM, cost of a human) to do the task.
I think the "state of the art" of measuring the quality of outputs was to send the same task to multiple "agents" and only accept answers if over a certain amount agree. With some human review and reputation scoring sprinkled on top. It was a while since I was in this field though
replyYeah, I was doing this kind of Artificial Artificial Artificial Intelligence back in 2012 to make some extra $$$. Glad they finally "patched" that hole ^^.
replyYou were using LLMs in 2012?
replyArtificial AI = stuff like mechanical turk where they get humans to do stuff computers can't do and make it look like it's "AI"
replyArtificial Artificial Intelligence = using computers to do mechanical turk jobs
You wrote the same thing twice, hehe.
replyBut the point gets across.
Artificial Artificial Artificial intelligence is when the chat bot is out of capacity, so a person in India is writing the response that gets returned by the LLM which gets pasted into Mechanical Turk.
reply"Artificial AI"
replyand
"Artificial Artificial intelligence"
are the same thing.
Come on. This site can do better.
yes, this site can do a lot better than nitpicking acronyms
replyThey were faking artificial intelligence by using real individuals.
replyThat's just Artificial Artificial Intelligence, the triple negative implies they built an automated system to impersonate humans who impersonate an automated system (which ultimately imitates a human).
replyFiverr-5.5 was the leading model back then.
replyLiving, Low-income Minions?
replyThis is my main argument as to why (people with) AI will not take over the world.
replyCheap, disposable, on-demand intelligence has existed for millennia.
If anything, AI is more of an equalizer.
Not LLMs. (Useful) LLMs came to the market around 2022.
replyI don't see why I would care how they do the job. Just do the job, I have other things to do.
reply