Even with the same model results are different. I work in a startup where they went bonks with AI ~1 year ago. Every employee got a Claude account that I don’t even know what tier is (we just have what feels like unlimited tokens), they implemented infamous AI usage leaderboards, people were getting “you’re not using AI enough” feedback and all of that…

Over time, it was impressive to see how much the output of the same prompt would differ between us, and it seems to be heavily influenced by the role of the user. I.e. answers coming from the agent of a Data Engineer, a Backend Engineer and a Domain Researcher would not be the same at all. Some of us use harnessing tools, some not, but regardless it we saw differences.

So, for example, when a backend engineer would send a question to a data engineer, there was *some* added value even when it was a lazy copy & paste.

You're giving too much credit to people. The folks who run an LLM council aren't the ones blindly copy pasting things.

There's responsible AI use (which I think you - and I, and many people here) do, and the "I don't care, I've outsourced my brain to OpenAI" type of people.