upvote

points

by yipinwong11 hours ago |
comments
upvoteby jaggederest11 hours ago|
next
[-]
This is about to bake your noodle:

https://www.postgresql.org/docs/current/geqo-pg-intro.html

reply
upvoteby Sesse__3 hours ago|
parent|
[-]
GEQO is not to get a better plan than the traditional optimizer, it is to be able to get a plan at all when the query is large. And it's widely known for creating poor plans.
reply
upvoteby jaggederest2 hours ago|
parent|
[-]
Yes, but it's exactly the kind of hybrid between a regular planner and something generative (writ broadly) that they were asking about. Practically speaking if you're hitting the GEQO you've already failed as a query writer unless it's a purely OLAP on a dedicated beefy machine.
reply
upvoteby Sesse__1 hours ago|
parent|
[-]
I think calling GEQO generative is a bit of a stretch; it's just a different way of searching through the same space with the same cost model. More or less devolving to “let's take a bunch of randomized join orders and see which one is best” :-)

And yes, large joins is definitely for OLAP use. If you have 20-way joins for OLTP, you're either crazy or you're using an ORM.

reply
upvoteby Sesse__11 hours ago|
prev|
[-]
The immediate problem: How do you know which one is better without running them?
reply
upvoteby haroldl9 hours ago|
parent|
next
[-]
You create formulas to estimate the cost of running a given query plan. Use statistics collected about the tables (e.g. how many rows) to try to be accurate. The topic is "Cost Based Optimization".
reply
upvoteby Sesse__3 hours ago|
parent|
[-]
If you have formulas that actually match reality, what do you need the LLM for? An optimizer is perfectly capable of finding the optimal plan if it has a perfect estimator. In fact, if you could only estimate the number of rows in each subplan perfectly, you have as good as solved the problem already.
reply
upvoteby pbalau51 minutes ago|
parent|
next
[-]
> If you have formulas that actually match reality, what do you need the LLM for?

Because one could be in that state where they are trying to use a tech they know preciously little about to solve a problem they know nothing about.

This reminds me of a request we got from our "AI Department": if you build us a proper shares market simulator, we will build you an awesome agent that can trade shares. They seemed quite confused when I pointed out that if we could build such a simulator, we wouldn't need them anymore.

reply
upvoteby locknitpicker52 minutes ago|
parent|
prev|
[-]
> If you have formulas that actually match reality, what do you need the LLM for?

That's the key question.

I think LLMs allow people with no context or background or know-how to dive into projects and see some results being presented to them, but they don't have the context or skillset to tell what they see before them.

This paves the way to people laying grand claims about achievements because of LLMs. Their claim is that LLMs know best primarily because LLMs knew more than them, not that the output is good or desirable.

reply
upvoteby HighlandSpring11 hours ago|
parent|
prev|
next
[-]
Could you A/B at random, use that to collect data and eventually feed that back in to prefer A or B depending on the shape of the query?
reply
upvoteby Sesse__3 hours ago|
parent|
next
[-]
There are papers and Postgres projects that attempt this kind of learning-based optimization, with some success. None are in widespread use. (One part, but certainly not the entirety, of the problem is that it's not just A/B, it's an exponential number of options that all could seem close to each other.)
reply
upvoteby mike_hearn2 hours ago|
parent|
prev|
next
[-]
You can and some databases can do this (e.g. Oracle).
reply
upvoteby adrianN6 hours ago|
parent|
prev|
[-]
Customers love it when their queries sometimes run a lot longer.
reply
upvoteby scarmig11 hours ago|
parent|
prev|
[-]
[flagged]
reply
upvoteby Sesse__11 hours ago|
parent|
[-]
This immediately halves your throughput.
reply
upvoteby mattashii11 hours ago|
parent|
[-]
Only in the worst case when the plans are equivalent: If one plan is significantly faster, then it'll finish first, and the loser can get canceled before it finishes.
reply
upvoteby 36199475211 hours ago|
parent|
[-]
Good and bad plans can have orders of magnitude performance difference. The bad one can easily do enough damage cutting the performance in half before it is canceled.
reply