upvote
While the GP might be technically wrong in a narrow sense, GPUs are built for FP, and that's what you want to be doing if you're using them as accelerators.
reply
You don't know what you're talking about: an enormous amount of TOPs now runs through quantized (read: integer) kernels. Many GPUs don't have even FP64 or even FP32 support.
reply
The quantized integer kernels aren't running true integer multiplication, the quantization is it's own thing, they're basically enums not integers.

Have you ever sat down and hand-done how to turn a number into a quantized integer, or done int4 multiplication by hand? It's not at all a normal integer.

And they're also not 24 bits of precision.

The only real reason GPUs have ever supported true integer math beyond stuff like tid/gid basics is for bitcoin acceleration, but that's nowhere near the speed of floats/quantized ints.

reply