upvote
At least folks like me care about it. My local hardware is more than enough to handle my app, but given Spectrum's internet service is as fickle as a broken fiddle I'm forced to rent a dedicated cloud gpu that sits idle most days. However, I would save a serious chunk of change if I could boot up a GPU snapshot in ~10s. I evaluated various options a while back and, while modal.com was the fastest, it still took around a minute-ish. Granted, my use case is unique, but I imagine this could be a decent solution for gpu-poor ComfyUI users.
reply
I work in a slightly different domain and I focus a lot on optimizing coldstarts.

Here's my 2cents: improve cold starts also means utilizing resources more effectively.

From cloud providers to end users - every ms both adds up and translates to additional waste of electricity/hardware and costs.

reply
deleted
reply