either ... portability is nearly instant except for KV Cache, which is extrodinarily expensive to store.
replyBusiness people do not even know what that is. Are you talking about models when the rest of us are talking about harnesses and the interface people use?
reply