There's definitely times where the question is 'hard' enough (usually having to do with something so business specific the LLM won't have a great answer) where a true human answer is needed, but I do regularly still get asked questions of 'why is x failing' with a datadog link. And if you shove the exact logs they've already found that contain a stack trace, the LLM instantly tells you exactly what was wrong.
replyThis is my experience as well. Some of my coworkers ask questions in chat that could be trivially solved by querying Claude. If I were tasked with answering that question, the responsible thing to do would be to query Claude rather than risking a manually-written incorrect answer off the top of my head. So yes, I will reply with "Claude says..."
reply