upvote
Maybe at very high level of abstraction, but there's no branching involved.
reply
Well, there are multiple token proposals processed in parallel, from which only one is picked, seems like branching to me. The only difference is that in case of CPU there is always only one possible branch that is correct.
reply
The concept of predicting future elements in a series is not specific to CS. It's older than computers.
reply
Well, the TPUs they're running on don't have branch prediction, so that had to end up somewhere in the stack.
reply