Yeah, I think Dspy often does not really show it's benefit until you have a good 'automated metric', which can be difficult to get to.
replyI think the unfortunate part is: the way it encourages you to structure your code is good for other reasons that might not be an 'acute' pain. And over time, it seems inevitable you'll end up building something that looks like it.
Yeah I agree with this. I will try to use it in earnest on my next project.
replyThat metric is the key piece. I don't know the right way to build an automated metric for a lot of the systems I want to build that will stand the test of time.
To be clear: I don't know that I would recommend using it, exactly. I would just make sure you understand the lessons so you see how it best makes sense to apply to your project :)
reply