Hacker News
new
past
comments
ask
show
jobs
points
by
amelius
3 hours ago
|
comments
by
unglaublich
3 hours ago
|
[-]
So I guess we'll all be applying a random rotation to our matrices now to obscure their contents, like TurboQuant does.
https://arkaung.github.io/interactive-turboquant/#rotation
reply
by
buildbot
2 hours ago
|
parent
|
[-]
Not that it super matters, but random hadamards for quantization have been a thing since way before turboquant.
https://arxiv.org/abs/2404.00456
reply