upvote
Maybe no tool calling, but seems it could be really good at deciding which tool to use and when?
reply
That is a good point. I do think these models would be good in the decision making. The large models are trained to use tool calling. Perhaps the small models can generate the text that would express their decision but not generate good JSON to reply with correct syntax. I do not know but this is my hunch.
reply