upvote

points

by temporaryacc213 hours ago |
comments
upvoteby redox9910 hours ago|
next
[-]
Thinking GPT2 was too dangerous is and was absurd.
reply
upvoteby gwerbin10 hours ago|
parent|
next
[-]
It's dramatic for sure, but at the time it was genuinely alarming to think through the implications of a machine being able to generate plausibly human-authored text. I think many of the alarming implications have in fact come to pass, and the world is a more strange and dangerous place than it was before.
reply
upvoteby NiloCK7 hours ago|
parent|
prev|
[-]
At that time, nobody believed a dead internet was technically feasible. Maybe this is hard to remember now.

The "danger" was in terms of spam / misinformation proliferation, not the same category of capabilities adjacent risks current discussed.

You can hold your own opinions on spam/misinformation as a problem, but to say there was no credibly anticipated outsized downside to a sudden jump in human-passing text generation feels pretty off to me.

reply
upvoteby redox996 hours ago|
parent|
next
[-]
I remember the arguments back then. Those alarmists were wrong. Nothing happened or could've happened just because you could generate drunken ramblings.

It's the kind of people that want to ban anything because of some theoretical small harm is technically possible. We're lucky it's not more prevalent or we'd still be in the stone age.

reply
upvoteby solenoid09371 hours ago|
parent|
[-]
It wasn't just "drunken ramblings," they were right about the dangers they called out. Reddit is largely LLMs arguing with each other, it's so easy and only costs a few thousand dollars to spin up a mass misinformation campaign.

They were right about the risks.

reply
upvoteby zahlman6 hours ago|
parent|
prev|
[-]
It's amazing to me that people actually thought GPT2 produced "human-passing" text, while I'm still tripping over obvious LLMisms in the output of recent models on a daily basis.

(It's also amazing to me that it took mere minutes for this observation, deep in a sub-thread, to get downvoted without any reply, with no obvious reason for it.)

reply
upvoteby NiloCK5 hours ago|
parent|
next
[-]
People may perceive you to be cheaply mischaracterizing the argument.

Nobody believed or suggested that GPT2 could do longform or produce novel text that stood up against careful scrutiny as insightful or well informed. But because the capabilities were novel, people would have no strong alternative than to believe some person wrote it.

You current tripping over LLMisms is irrelevant. You have years of antibodies, both personal and herd-immunity (eg, the many, many articles and comments that describe LLMisms).

reply
upvoteby aesthesia4 hours ago|
parent|
prev|
[-]
LLM-isms are much less prevalent in base models, which is what GPT-2 was. It had significant problems with maintaining coherence, but GPT-2 generated text did not have the obvious tells of today's LLMs.
reply
upvoteby cmrdporcupine5 hours ago|
prev|
[-]
All that happened was announcing said potential risks and then continuing to launch and push and release it anyways. Something that Anthropic continues to do under his leadership.

Google also analyzed for risks earlier in development of "Meena" and "Bard" and chose not to release, instead. And then got caught flatfooted when OpenAI did so anyways. (They also I think didn't really see a compelling business case for public propagation of it, either).

It starts to look very much like what is really happening with Anthropic is a lot of cynical attempts at regulatory capture. Make grand proclamations. Get your stuff out there first. Ask for regulation and then kick the ladder away from underneath you. But they did it clumsily and failed to grease the right palms.

reply