upvote
Right, that's always been true for LLMs + constrained generation. It ensures syntactic correctness, but semantics are "best effort".
reply