Distillation does not require access to weights.
replyIsn't distillation more of a black box type affair?
replyDoesn’t really matter what happens at the GPU level when Google can see all API traffic.
replyExcept google cloud doesn't use Nvidia GPUs but TPUs.
replyGoogle has both. Afaik we don't know whether OpenAI models will run on TPUs or GPUs here.
replyI bet it would be the NVIDIA, at least initially, not for the encryption capability per se, but for simple fact that adapting to TPU at high performance is non-trivial.
reply