upvote
They also need to tell people what quantisation they're using. Because some 4 bit version is not the same as BF16, no matter what KLD suggests.
reply
lol, exactly.
reply
Your assumption is incorrect.
reply