You can disaggregate though. So draft models can run on cheaper hardware with less RAM, saving time on the more expensive machines with more RAM.
replyI think it also gets use in the /fast modes the providers sell at higher cost.
replyThey probably use it on all models. Fast is probably just a resource pool with less congestion and therefore faster throughput per user but less efficent.
reply