Why not both? You don’t need 1trillion allocated before you have a proof of concept to demonstrate your non-LLM model, and once you have a PoC you will definitely have the larger investors interested
replyYou will need 100s of billions to make a viable POC.
replyFor a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude
replyLet's wait 10 years and see.
replyIn 10 years the world will not be the same.
replyYou only need to train a range of small models in order to establish a plausible scaling law, IMO.
reply