It’s an artifact of the documentation being AI generated, they usually pick gpt4-era models, without giving it further thought.
replyFor Gemini it seems to always pick 2.5 despite 3.1 being the latest, Claude the 3.5-era models.
Not sure what’s preventing AI labs on ensuring this stuff is refreshed during training.
I was wondering the same and learned the model doesn't know about itself during training [0]
reply[0] https://developers.googleblog.com/closing-the-knowledge-gap-...
The skill is deterministically added to the prompt by the harness before the target model is invoked. There is no “choosing” to load a skill. You might be confusing skills with tools (MCP etc).
replyThe metadata is loaded by the harness, but the LLM still needs to choose to load the rest of the skill, no?
replyDefine “load.” It follows the instructions in the prompt - its natural behavior.
replyConcretely, it has to decide whether it is in a circumstance where that skill is useful, pull the instructions into the context and follow them.
reply