upvote
> The worst thing about the top AI companies is that they are based in San Francisco, and comes with it the latent cultural attitudes of controlling what other people do.

And an even worse thing to me is they seem completely oblivious to how onerous and obnoxious this is. It's a complete bubble.

reply
I think they know exactly how onerous it is.

They have access to unaligned models beyond what they released publicly they can aim like a compute cannon at any problem, or rent out to the most special of people.

Meanwhile we can scrounge around in the dirt with the latest abliterated Chinese open model that hopefully isn't too damaged.

It's obvious to me the US labs' dream would be to eliminate open models and totally and tightly centrally control the scope of what AI can be used for.

reply
>It's obvious to me the US labs' dream would be to eliminate open models and totally and tightly centrally control the scope of what AI can be used for.

Well Dario has come out and said it, it should be obvious to everyone. [1]

>All sufficiently capable models, open and closed, should go through mandatory safety testing.

Also gotta love the next part where he implies closed-weight models will be more aligned.

>But I don’t agree with the letter’s assertions that open-weights models necessarily make it easier to develop safeguards or that broad access to capabilities necessarily helps defenders more than attackers.

[1] https://www.anthropic.com/news/position-open-weights-models

reply
Oh they know. For all their superficial leftward leanings Silicon Valley has always been a might-makes-right society. In their minds they are the settlers and the rest of us are the primitive natives who need.. uplifting.

Think Viltrumites from Invincible but with no physical prowess

reply
You're not wrong, but what do you think you'd get from AI companies based out of, say, Salt Lake City? Underwear shopping would sure be a novel experience.

Where are you going to go? The largest city in the "live free or die" state has 115k people, probably not enough to sustain an AI lab.

reply
There are definitely issues here, I agree. If you were to create a tech center in Nashua, NH or Salt Lake City, are they still the same thing? A place is its people and that would probably change the culture fundamentally if you had 100k tech workers come in.

Now I think that this is all downstream of the educational system replacing fundamentals of western civilization with modernist philosophy, social activism works and social sciences that have a certain bend. If we had people raised more well versed in the canon of the west they would be less hell bent on destroying it.

reply
> latent cultural attitudes of controlling what other people do

I think the attitude is more basic than that: I have the most brilliant idea in history and I deserve to be rich because of it.

AI safety is at least partially a marketing ploy, meant to reassure everyone that AI will simultaneously rewrite the rules of human existence without doing anything "bad" under the current rules of human existence. The irony is that these systems are not achieving either one of those goals, the abusive users get around the safeguards and the agents are not rewriting much of anything. But hey, at least it's making people rich!

reply
>The worst thing about the top AI companies is that they are based in San Francisco, and comes with it the latent cultural attitudes of controlling what other people do.

Yes, the city that birthed hippies, counter-culture, the open Web, etc. is inherently about controlling you. Sure thing.

reply
I think 1970s Berkeley is an incredibly different culture than 2020s Silicon Valley.
reply
The boomers did all that hippie stuff so yes, unironically. Your failure to see it is noticeable
reply
I can imagine where you're coming from, but it's just as annoying from the other side. There's no point in trying to use it to work through thoughts related to class or historical racism or socialism; it's fundamentally skeptical of anything your average SF tech employee doesn't subscribe to, on the right or left.

And god forbid you try to generate a video of a bare butt. Prudes.

reply