I do some work in laboratory automation and it was quick to refuse the first thing I asked it to do. There wasn't anything spicy in the request, just basic liquid-handling protocol implementation. Their position seems to be that they're too stupid to classify requests safely, and that seems reasonable to me. I'd guess the classifier will improve rapidly.
replyHave you tried locally running qwen?
replyIs there a Qwen that I can run locally that is anywhere near these frontier models?
replyNo, and don't let anyone gas light you into thinking the answer is yes.
replySame. I'm working on a set of python and matlab scripts that deals with segmenting MRI images into brain vs skull, and it thinks that's bioterrorism.
reply[dead]
replyQuite counterproductive to refuse to help on health issues too. If they detect health data, they can add a disclaimer, but not hide the information.
replyYou miss the point - by collecting and processing medical data they would fall into a thoroughly regulated industry. Not because they may provide you incorrect data, because they are not allowed to process them.
replyWhat custom prompt do you have set up? If you tell it you're occupation, does it turn helpful? There was a study that if you tell models they tested that you're a patient, it would refuse, but tell it you're a doctor and suddenly it turns helpful.
replyAccording to the model, it’s not the model itself that’s doing this, it’s the harness.
replyAssuming the model is being “truthful”, CC is just being stupid in its detection mechanism.
Anthropic knows it refuses too much, they want to be very cautious to avoid any scandals. I think this is why they want to store all Fable and Mythos chats for 30 days so they can use the data to improve.
replyThey want to be very cautious to honour the important doctrine at least until IPO launches: we are so good we are nerf our products.
replyI’m a point where I expect everything I do will be retained indefinitely.
replyI’m having a really hard time believing some weak reason for a 30 day retention policy.
There’s no way around it? Can’t you obfuscate as generic data and use keys to map to the real data?
replyI guess you could even turn everything into numbers, not a bad idea at all!
replywhat prompts do you use for this?
replyI wonder if it sees Healthcare companies being targeted and that's why it's freaking out; clearly they have some pretty stupid regexes in the harness to detect this sort of shit.
replye: I quit the session and went back in. Set it to Fable and told it to continue the last session. It's moving along as if none of that had happened.
How weird.
I wonder if this letter has anything to do with why anything even remotely related to biology is getting flagged.
replyhttps://www.wired.com/story/openai-anthropic-letter-ai-biolo...