the GPU competition is using 16 gpus, so the actual comparison is that the CPU has <1/10th the bandwidth
replyThis is essentially guaranteed. There are lots of useful smaller models that we should be able to run locally. Over time they'll be more and more capable and require less API usage.
replyIm wondering if we are finally seeing the end of the "hard disk" era, and are entering a new era of vast instant on systems.
reply