They can be super complementary! Open weight models can be your everyday standard goto, and frontier models for the harder and bigger tasks.

Having some open weight deployment or vendor is also a good thing, because you may have domain specific tasks where you can get better results on domain specific problems with a quick finetune.

Unsloth makes it particularly easy. Open weight LLMs are incredibly powerful building blocks.