I think this is not too different from physical products, either. You often hear of companies spending multiple years and iterating through dozens of prototypes in order to bring something new to the market.
I don't think there is a shorter path: you never truly understand a problem until you take up the engineering work to solve it.