But no matter how conservative they make the anti-jailbreaking, the risk doesn't go away. There are so many logic "holes" that are ambiguous and can blur the line between a jailbreak and legitimate use.
replyIf every time a jailbreak is discovered, the model has to be turned off and jailbreak prevention updated, the effect will be the same regarding how willing users are to adopt it.
Also this falls into the "right to bear arms" thing: if LLMs are limited legally, then illegal LLMs will be the superior choice. This is pretty much the plot of Cryptonomicon and Corey's take on I, Robot
replyExcept there’s a large hardware barrier to entry, which for now seems effective.
replyRelated note. Cryptography has been subject to export controls for years and manufacturers bend into pretzels to meet the laws, regulations, and policies.
I don't get the emphasis on known vulnerabilities. The jailbreak already works on previously known exploits? That seems a bit weird.
replyAnti-jailbreaking and passport verified access to model families.
reply