Optimal (maximizing your benefit... and also cost in lost tax receipts) use of HSAs requires not touching the money until retirement. You pay medical bills with non-HSA money and keep the HSA money invested and growing tax-advantaged, like an extra retirement account. Spending the money you put in every year offers relatively tiny gains compared to keeping it in those accounts for decades.
Your options to mitigate this are to limit access, or to make it undesirable to keep money in them long-term, approaches to which look kinda FSA-like.
We could just continue to enforce the 20% penalty indefinitely to get rid of the concept of these accounts turning into retirement accounts.
FSAs benefit the upper-middle-class and wealthy more than poor people as well. You'll see quite a bit more savings when your top end tax rate is 35% than 12%. They're also far more likely to be able to plan on setting aside some portion of their incomes into a FSA at enrollment time rather than the bigger effects of the gamble with lower income earners; the outcomes of the risk of overfunding is way more impactful for someone making little money.
The tax benefit helping the wealthy more seems to me to move more towards eliminating the tax advantages of healthcare spending entirely.