upvote
structured output { "answer" : "Misleading", "reason" : "Almonds..." }

Have reason be optional and instruct it to only provide reason for the middle "Mostly True" or "Misleading".

reply
Sure, but people are drawing conclusions beyond "LLMs said different words" and trying to use it to analyze whether LLMs were wrong about the underlying facts, but that information isn't available to us.
reply