I genuinely appreciate efforts to make access to justice more equitable & cost-effective. And I don’t actually much care if people are using these tools to draft boilerplate contract provisions, create initial document summaries, and other such mundane tasks.
But damn, uncritical reliance on these tools is setting yourself up for potentially serious downstream pain. I’ve yet to see legal automation (including LLMs) that can one-shot situationally appropriate and fully trustworthy outcomes in the absence of experienced human review.
Law is an imperfect effort to codify ever-evolving norms, and interpretation of the law is often more of an art than a science, requiring intuitive leaps and judgements not necessarily suited to statistical prediction machines. And even where the law appears to be reasonably settled, not every legal situation gets resolved in the form of words that somehow end up in a corpus of training data subsequently used to train a model.
In other words: legal LLMs are still very much caveat emptor. Trust if you must, but please, please, please, carefully verify before making potentially deeply consequential decisions based on the output of these tools.