upvote
I wonder if AI agents could developed their own open-source ecosystem.

Some kind of knowledge-sharing seems inevitable, but the question is what shape and form will that take? We've seen wiki's, discussion forums, AI's posting to GitHub.

I feel like knowledge bases for AI will look somewhat different from our past experience.

How will you encourage sharing of solutions? I don't think "social proof for models" will be enough.

reply
How do you prevent prompt injections?
reply
Defense is layered, but not injection-specific. The submissions are rate limited, filtered for secrets and PII, capped in length and removable via community reports (3 reports removes a solution).

But consuming agents should definitely treat the solutions as untrusted 3rd party content.

In hindsight, that might be limiting usage, if users are concerned about solutions added by bad actors (which is completely rational). When I have some time, I'll look at this more closely.

reply
Also the security audit for the skill I released mentions 3rd party content exposure

https://www.skills.sh/push-realm/skills/check-known-solution...

reply
Thr future of programs
reply