It may be an implementation detail, but in practice, if the only way to get a deterministic output is to run on the CPU, then it's not going to be usable.
replyActually, Google's TPUs are also deterministic!
replyYou can tell GPUs what order to do math instructions in.
reply