Server side means an excuse to not improve model handling everywhere you can, and increasing global power usage by noticable percentage point, at a time when we're approaching "point of no return" with burning out the only planet we can live on.
replyThe cost, so far, is greater.
> Server side means an excuse to not improve model handling everywhere you can...
replyHow so if efficiency is key for datacenters to be competitive? If anything it's the other way around.
The previous commenter is right in that server-side companies have little incentive to do less, especially when they're backed by investors money. Client-side AI will be bound by device capabilities and customer investment in new devices.
reply