It's the FP/BF16 FMA to FP32 instructions.
replyAnd also it does work on most 3000 series cards as they all run the same GA102 booter that's vulnerable :-) There are some reports of cards with weird vbios layouts having issues but i'll try to get that fixed
The repo has fp16 numbers.
replyAlso this one for 4070s shows that its for fp8 as well:
https://github.com/JustAResearcher/gpu-unlock-ada/releases/t...
it's the widening (for example: fp16 * fp16 = fp32) instructions, which are useful on some loads.
replyI assumed the comment above is referring to operand dtype and not accumulator dtype since they mentioned ops. In general even for nvfp4 you use fp32 accumulators because you are usually reducing over large Ks which mean large values.
replydeleted
replyThe repo has a lot of reports of people applying it to other 3xxx card, see https://github.com/Zagitta/gpu-unlock/issues
replyThere's at least 3080 Ti, 3070 Ti, 3070, 3060
There's also a Windows version:
reply