the counter point is that building or selecting the specialized model may cost as much as the lifetime inference costs of the task with the specialized model.

If I need to pay someone 300k to make the model and infrastructure... then I would need to process many documents to recoup my OCR costs compared to asking claude code nicely.

Perhaps the model zoo is becoming good enough that the cost to find a specialized model is not so high?