upvote
It's important to be aware that while those "thoughts" can be a useful aid for human understanding they don't seem to reliably reflect what's going on under the hood. There are various academic papers on the matter or you can closely inspect the traces of a more logically oriented question for yourself and spot impossible inconsistencies.
reply
It doesn’t mean that these “thoughts” influenced their final decision the way they would in humans. An LLM will tell you a lot of things it “considered” and its final output might still be completely independent of that.
reply
Its output quite literally is not independent, as the "thinking tokens" are attended to by the attention mechanism.
reply
They do not in fact do that. The ‘thoughts’ are not a chain of logic.
reply
deleted
reply
You have a fundamental misunderstanding of what the model is doing. It's not your fault though, you're buying into the advertising of how it works
reply
Those are a funny progress bar made by a micro model , is just ui
reply