OpenAI is the company that originally proposed and popularized chain-of-thought monitoring: https://openai.com/index/chain-of-thought-monitoring/
replySo no, Google is not being punished, nor are they the people behind this technique.
deleted
replyYeah, Zvi calls it "the forbidden technique"
replyWhat? You mean the technique they had turned OFF during all training run where the agents they are responsible for hacked huggingface?
reply[dead]
replygoogle does not return real chain of thought via the API. you can't monitor it.
replythey use a small model to make fake chain of thought and return that.
google has access to the real chain of thought.
Mmh ok. How much theoretical speed or 'intelligence' gain is realized by allowing reasoning to occur in some inscrutable intermediate representation? Has this been actually tested, how much is it slowing them down, and compared to whom exactly?
reply