upvote
What are his actual credentials? What did he achieve? Isn't he just some random dude on the internet? Why do people care what he says?
reply
> What are his actual credentials? What did he achieve?

He cofounded the Machine Intelligence Research Institute, an organization focused on AI alignment, in 2000, way way before it was a trendy topic.

He's also partially responsible for popularizing ideas such as the orthogonality thesis and instrumental convergence.

> Isn't he just some random dude on the internet?

Not really, most random dudes on the internet were not researching AI alignment in 2000.

> Why do people care what he says?

Many people were introduced to the concept of AI alignment thanks to him, so they are naturally interested in reading his reaction to progress in the field.

reply
I've read the wikipidea page of MIRI, and it does not mention any achievements; just that it was founded "with the purpose of accelerating the development of artificial intelligence". Did they advance the field of AI alignment at all? Being concerned with a problem does not make one an expert.

For the rest, is he just an AI influencer? One that predated his topic of interest, but still just an influencer?

reply
> Did they advance the field of AI alignment at all?

Not directly. Exotic decision theories were a dead end; as far as I know nobody outside of MIRI even cares about them. Certainly they’re not relevant to interpretability in the context of this thread.

reply
Yes, he is a very influential AI doomer/influencer. All the big names at the AI companies read his blogs in the aughts, see also https://skywriter.blue/@segyges.bsky.social/3mvom4b4dn22q
reply
It's a non-profit that pays his salary and puts out the occasional research report every 7 or so years. It relies on donations. It operates on a long tail approach, in the hope of enticing a billionaire to donate a lot.
reply
Also, here is a list of his papers and citations.

https://www.semanticscholar.org/author/Eliezer-Yudkowsky/254...

reply
He tells spooky stories on the internet to make money. He has told numerous spooky stories. Yes. Spooky stories grab the attention of many people (understandably, given all the wars and plagues and famines in previous centuries).
reply
> He tells spooky stories on the internet to make money.

I mean, yes, but so does the author of this article. It's literally his business. The article is, in part, an advertisement for what he sells.

I disagree with Yudkowsky on almost everything and I think the philosophical movement he co-founded is a pox on the SF Bay Area tech culture, but I don't think we can deny him credibility that's comparable to the credibility of the author of this article (who, as I understand, is a young guy who spent some time at OpenAI). They both know what they're talking about and both are motivated to reach specific conclusions.

reply
> I mean, yes, but so does the author of this article. It's literally his business. The article is, in part, an advertisement for what he sells.

The author also publishes research and contributes to the field. This is the primary difference. Yudkowsky ONLY tells stories.

reply
yes, he's an author fist and a researcher/scientist second. He has no peer reviewed publications in his name.
reply
have you read his harry potter fan fiction?
reply
When a random dude with no credential has enormous influence and cult-like followers you can assume they are an agent of influence.

https://en.wikipedia.org/wiki/Agent_of_influence

reply
He runs a cult, that requires something I guess.
reply
That's because he's worried about super-intelligence. If LLM's are a normalish tech this is a good step
reply
No one cares what that guy says.
reply
Why do you care about a cultist ?
reply
Let him come here and comment, then. I’m amazed this rape cult leader immersed in his fantasy world still gets traction amongst HN.
reply
By 'rape cult' I assume you're referring to the zizians? https://en.wikipedia.org/wiki/Zizians - the internet is convinced Yudkowsky has nothing to do with them, so it's pretty disingenuous of you to claim otherwise without citing sources.
reply
I think the allegations for the LessWrong types started with the math pet thing?
reply
Math pet?
reply
It's a nice can of worms, that one.
reply
I assume they're referring to this: https://news.ycombinator.com/item?id=49737985

There have been plenty of allegations about the rationalist community beyond the Zizians, who really don't even qualify as a sex cult as far as I know? Violent, obviously, but they seem... ideologically asexual?

reply