It would make memory-poor phones more viable. Like why can't we have a 512MB, or even 256MB RAM phone. Although I doubt that the software effort would be cheaper than just buying the extra RAM. It's definitely much more uncertain.
That's newly fabbed memory vs. an existing stock. The stock is quite massive, so optimizing existing use and enabling it to be repurposed can be meaningful.
If the existing MacBook needs less memory, it can use its current memory spec for higher-level uses that formerly required a MacBook Pro. That meaningfully affects the market.
If your point is purely about supply and demand for datacenter HBM and LPDDR, you're probably right. Local model inference (using the existing memory stock) can make a dent in current use, but not in projected future uses that will plausibly involve much larger models.