Or on a commodity EC2 instance with a relatively cheap inference sidecar.