Sure, but TFA is trying to use Qwen's reaction to the thoughts as proof that they did indeed extract thoughts to train on.
replyMy point is that any model trained after August 10 will know of those specific thoughts.
I'm sorry, it's going over my head still - my reading is "all models with any training after August 10 know how GPT 5.5 Pro thinks", but I'm not sure why - my initial guess was that's when GPT 5.5 was released, but that doesn't seem to be the case (it was released April 23rd).
replyThey would know the specific thoughts released by the "stolen thought" paper, which became part of the public internet on August 10.
replyUnfortunately those are the only thought examples you can use to perform this experiment, as no other are availible.
But as the model should have seen those specific examples, it's not a good signal that Qwen was exfiltrating thinking traces.
Has the method for extracting the COT been blocked, now? Otherwise why could we not generate some fresh samples?
replyI'm not sure how viable it still is. Perhaps it's still possible, and perhas that's exacly what they did in wtich case my objection falls, but I don't know.
reply