upvote
What does the number before the B signify?
reply
Its number of parameters. The 'B' is billions. If you have bf16 weights each parameter would be 16 bits.
reply