upvote
in terms of performance the formula seems to be : dense parameters = sqrt(total*active)
reply
You do need to compare active parameter too though. The total size isn’t a reliable indicator anymore
reply