I think the general local models are better than you are giving them credit for--I have heard/read good things, at least.

Have you tried the open weight models, but not locally? Like, using it from a provider. That way, you get access to better models while still not using private closed models, anyone with enough compute can host them, not just the big AI corps.