Could it be that they have to serve their models to billions of users?
reply> Could it be that they have to serve their models to billions of users?
replyAnd how is that different from their competitors exactly?
[dead]
replyI'd guess they did model-hardware codesign but the design ended up limiting the scaling capability of the model (i.e. they overoptimized too soon).
replyGoogle Cloud is probably Google Deepminds biggest competitor. Big company kinda bullshit.
replyHow so?
replyGoogle cloud sells compute out from under Deepmind to other labs. So they basically are in competition with Google cloud for compute.
reply