"But we anonymize prompts before training!"

Meanwhile the prompt: Crop this photo of my passport

Oh yeah that’s in the “These Are The Illegal Things We Did” section 7.4 in the Model Card.