You still have to be pretty careful it doesn't have access to any API keys it could decide to exfiltrate...
replyHow would it have access to API keys? You don’t put those in your git repo, do you?
replyIf the code can call a method that provides the API key, what would stop the LLM from calling the same code? How do you propose to let an LLM run tests that execute code that requires API without the LLM also being able to grab the key?
reply