why not in a legal sense? If someone asks me what cleaning supplies are safe to mix, and i just ask some chatbot, don't vet the output, copy the response, and they end up poisoning themselves, am I not responsible?
If I'm a lawyer, and pass unvetted AI legal advice to my client, and they go to jail, should i keep my license?
Developers are perfectly capable of creating dangerous or expensive mistakes even without LLMs. If we accept that LLMs are just tools, the developer should be no more responsible that if they choose to use Visual Studio over Vim and Visual Studio refactors something wrong.
Theres's then the question of gross incompetence, and were the developer could be fired or perhaps even sued by their employer, the same as if they hadn't used an LLM.
However the case I had in mind was in regards to the legality of the way the AI models acquire and reproduce code. We're not held personally responsible for any license violation created by the tool.