upvote
You don’t even need electricity. You could print the model weights onto millions of sheets of paper, and hire a team of carrier pigeons to fly them into your office one by one. No VRAM!
reply
Coincidentally that’s also Google’s new method for distributing Android sources.
reply
The bitrot would be excessive
reply
The key to running in lower amounts of VRAM is patience. It'll be slow, but it'll work.
reply