statichost.eu is a CDN,[0] not a single static host. Your VPS is the single point of failure, so if that one system goes down, your site is offline.
With a VPS, you'd also have to roll your own atomic updates, which is not the hardest thing in the world, but it's also not trivial.
Compare it to static hosting pricing at Netlify, Firebase Hosting, and Vercel, and it's competitive, but you should expect to pay more for a service run by a small vendor who doesn't have the economies of scale or VC money that the bigger competitors have.
[0] They're an abstraction on top of Bunny, who provides the actual CDN, statichost assumes responsibility for providing the CDN regardless of underlying infrastructure.
Just checked again and found a DEV configuration for ~€6.55 and STARDUST for ~€0.43 which is interesting.