I call BS. That’s what you might think when reading many legal briefs. In their zealous advocacy of a client’s position, sometimes lawyers become… well… overzealous, and they stretch the meaning of the law. They may know they’re doing that, or they might just be confused about complex legal issues. Either way, they end up mischaracterizing what a court or legislature actually said. What if we had a BS detector for briefs? Many years ago, when we were building Quick Check in Westlaw to analyze legal briefs, we thought, we should build a BS detector to find instances where lawyers make these types of “mischaracterizations,” but traditional machine learning approaches were not powerful enough to do it well. With the emergence of LLMs and some sophisticated work from our product and data science teams, Westlaw (and soon, our GenAI Assistant, CoCounsel) can now call BS on these types of issues. Customers can upload a brief to Westlaw and see where opposing counsel has mischaracterized the law, and judges using this feature (in the tool we built specifically for them, Judicial Quick Check) can see where all litigants may have mischaracterized the law in their filings. I’m grateful for the amazing work on this by Carol Jo (CJ) Lechtenberg, Gayle McElvain, Masooma Ali, Merine Thomas, Pasan Dangalle, Brian Phillips, Ben Petersburg, Kevin Lane, and David Kerman. https://lnkd.in/ewXGEJmK
I’d love to test this out.
Not always the case. If you're using valid information from a series of information it's not mischaracterization, it's interpretation.
I just posted something (less colorful)!) like this last week
I heard a podcast recently that referred to this design pattern as "sprinkles of intelligence". Hope to see more examples of this in the future!
Now this is going to be a really useful function. Too many lawyers never learned how to properly read and squib a case (believe it or not). Misrepresentation of your case law is about as egregious as not making sure it’s still good law.
So cool 🙌 very well done to the team 🚀
Wow
Detector of "Hallucination by Lawyer".. But ofc, it happens all the time! I really like this and can be applied on a large variety of levels. Possibly a new use-case type, I'd even say! Thanx for sharing!
Partner / Chair of Analytics Practice at Barnes & Thornburg LLP (AI/Machine Learning/Cryptocurrency/ESG)
1moDare you to trademark Westlaw BS index