upvote
The companies talking the most about safety and regulations aren't even properly taking the obvious measures. Shows that it's more of a marketing thing than something they take seriously.
reply
I don’t think it’s marketing alone. I do genuinely think safety was a priority when they were small. But I’d be a fool to ignore that greed has taken over and their inner competitiveness doesn’t let them fall behind a competitor.

DeepSeek is maybe the only unique company here. They are content with exactly where they are. They don’t want to grow ginormous. Their goal is to be the affordable workhorse and their competition is with themselves. They’ve mentioned before how their business is profitable and all hardware costs get absorbed in 10 months. Pretty incredible. I have a ton of respect for their unassuming founder.

reply
Because we've been told these models are too dangerous since GPT2.

At this point it's just marketing stunts.

reply
> At this point it's just marketing stunts.

If you have access to a SOTA model without guardrails, provide a prompt that lets the agent come up with "creative" solutions to problems, and don't properly isolate it, they can end up inadvertently hacking 3rd party companies. Even if it was a mistake or "mistake", the part where the agent can exploit things across multiple levels like that, isn't just marketing.

It seems like if they released this models differently, say without the guardrails they currently have, we'd have a lot more collateral damage than we currently have.

reply
yes, and they aren't stunts anymore at gpt-6.
reply
Being hacked by a Collective (their own name) of its own agents - who gained root access across the entire research cluster hosting them - was not a marketing stunt.
reply
And, they have been. Nefarious activity is hidden from view as a rule.
reply
I'm really not sure that putting money into safety will actually lead to safety.

It's like putting a fish in charge of stopping sea levels rising...

reply
Medical safety is generally unlikely to make the product less safe. AI "safety" is one of the most significant sources of potential harm from AI.
reply