> there's no reason to think those gains get captured by the model makers or inference providers at this point

Yeah it almost certainly won't be captured by them. That value is going to be captured by the folks/companies that shrink wrap the capabilities into a nice SaaS or other tool, that a business can buy off the shelf and give to their employees.

The model makers are on a fast track to just becoming dumb pipes, not unlike ISPs.