Intuitively it feels like focused models should be better models, but human programmers are ‘better’ knowing programming alongside general stuff. We’re not reduced by reading economics or Tolkien, removing such knowledge would be premature optimization.
Would be nice if a genuinely useful coding model can fit into an old laptop, give decent performance and know nothing but (say) Go or c language.
But I see yours + others points.