[Author] Basically what we are doing with the help of Trino: a distributed query engine which can use as many resources as the query needs dynamically.
replyThere is an elastic option, I think . Also, even with a specific warehouse, not every query uses every node in the warehouse.
replyRight, there is an option to scale horizontally, if a lot of queries are queued, Snowflake can spin up another node. But that doesn't help if you query is spilling to remote storage. You need a bigger node to speed up those queries.
replySnowflake has an option to add more resources, which is supposed to be vertical scaling, but it doesn't work as well as increasing the size of the warehouse
The query planner / optimizer does not run in the warehouse. One of its primary functions is to predict this stuff.
reply