You will need 100s of billions to make a viable POC.
replyFor a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude
replyLet's wait 10 years and see.
replyIn 10 years the world will not be the same.
replyYou only need to train a range of small models in order to establish a plausible scaling law, IMO.
reply