upvote
seems like only the companies in question could run this sort analysis long-term; since they have full access to their CoTs not in public datasets.
reply
and we have to "trust them bro" to be fair and accurate, something I am very unlikely to do given their other false / misleading statements to date
reply
And the only end result would be that the Chinese trained on their data just like OAI and Anthropic trained on our data so who cares
reply
As I understand, AI is a (paid) tool for text generation, so it's totally ok to generate texts using it for whatever purpose you need.
reply
capitalism ensures I get high marx on my Ai bill
reply
The thoughts trick was known before their paper / August.

I "independently" "invented" it for the first Anthropic reasoning models because the API required you have thoughts for each assistant message. My app lets you switch AIs within a chat, and their API used to require thinking for all messages if thinking was enabled, so I needed to get a valid thinking stub to insert.

Time has flew by for me the last 3 years, but, I'd guess it's been at least 18 months. And IMHO it wasn't very complicated to work through how to do once you were dead set on making it happen. I expect it was well-known to distillers before the paper.

reply
Sure, but TFA is trying to use Qwen's reaction to the thoughts as proof that they did indeed extract thoughts to train on.

My point is that any model trained after August 10 will know of those specific thoughts.

reply
I'm sorry, it's going over my head still - my reading is "all models with any training after August 10 know how GPT 5.5 Pro thinks", but I'm not sure why - my initial guess was that's when GPT 5.5 was released, but that doesn't seem to be the case (it was released April 23rd).
reply
They would know the specific thoughts released by the "stolen thought" paper, which became part of the public internet on August 10.

Unfortunately those are the only thought examples you can use to perform this experiment, as no other are availible.

But as the model should have seen those specific examples, it's not a good signal that Qwen was exfiltrating thinking traces.

reply
Has the method for extracting the COT been blocked, now? Otherwise why could we not generate some fresh samples?
reply
I'm not sure how viable it still is. Perhaps it's still possible, and perhas that's exacly what they did in wtich case my objection falls, but I don't know.
reply