upvote
“Average” is also doing terrible things there. The “average GPU” is probably the integrated graphics on the CPU of a laptop.

If you scoped it to “average gaming desktop”, double digit VRAM is pretty normal at this point. If costs came down, I imagine the higher end GPUs would start including enough VRAM for 30B-ish models.

reply