upvote
1-bit g128 with a shared 16-bit scale for every group. So, effectively 1.125 bit.
reply
I was excited about the 1.58 bit models from a year or two ago, but the never seemed to go anywhere. Curious in particular how this scales up.
reply
1 bit or 1 trit*
reply