BRENNEN

Industries / Finance and business services / Legal and professional services

Legal research

Finding the statutes, court decisions and rules that govern a question, and checking that they say what they are cited for.

7

Milestones achieved, from 1973 to 2025.

1

To watch for: announced, not yet confirmed outside.

2

Open deliverables. Nobody has shipped them.

The road

AchievedWatch forOpen

Achieved

  1. 1973

    Full-text search of case law

    Mead Data Central put LEXIS on sale in early 1973 with the full text of selected Ohio and New York law, so lawyers could search every word of a decision from a terminal. Lawyers in the Ohio and New York bar projects had used it before the commercial launch.

    librarycollections.law.umn.edu

    Credit

    Mead Data Central (Jerome S. Rubin)

  2. 1978

    Westlaw goes full text

    West Publishing launched Westlaw in 1975 with only its headnotes, the short summaries of each point of law that West's editors write, and not the decisions themselves. William Voedisch, who built the system at West, wrote that the choice "took us nearly five years to recover from". In November 1976 West ordered that Westlaw be full text by January 1978.

    LessonUsers who had learned to search every word of a decision would not settle for searching summaries.

    librarycollections.law.umn.edu

    Credit

    West Publishing

  3. 1992

    Free law on the web

    Law professor Peter W. Martin and technologist Thomas R. Bruce built the Legal Information Institute at Cornell Law School in 1992, which Cornell calls the Internet's first legal website. By Cornell's 2012 count it had about 14 million visitors a year.

    news.cornell.edu

    Credit

    Peter W. Martin, Thomas R. Bruce

  4. 2018

    Six million cases scanned

    Between 2013 and 2018 Harvard Law School Library scanned over 40 million pages of printed US court decisions, with the legal startup Ravel Law, and released them as the Caselaw Access Project. Its limits on access expired in March 2024, and the data can now be used without restriction.

    lil.law.harvard.edulil.law.harvard.edu

    Credit

    Harvard Law School Library Innovation Lab, Ravel Law

  5. 2023

    Cases that did not exist

    In Mata v. Avianca, a federal court in New York ordered two lawyers and their firm to pay $5,000 after they filed a brief citing cases that ChatGPT had invented. Judge P. Kevin Castel wrote that there is nothing "inherently improper" in using AI, but that "existing rules impose a gatekeeping role on attorneys to ensure the accuracy of their filings."

    LessonA citation has to be read, not just found.

    lawnext.com

    Credit

    Judge P. Kevin Castel, US District Court for the Southern District of New York

  6. 2024

    Research tools measured

    Stanford researchers tested AI research tools from LexisNexis and Thomson Reuters on more than 200 legal questions written in advance. Lexis+ AI and Ask Practical Law AI gave incorrect information more than 17% of the time, and Westlaw AI-Assisted Research more than 34% of the time.

    hai.stanford.edu

    Credit

    Varun Magesh, Faiz Surani, Matthew Dahl, Mirac Suzgun, Christopher D. Manning, Daniel E. Ho

  7. 2025

    AI beats a lawyer baseline

    Vals AI, an outside testing firm, had lawyers and law librarians grade blind the answers to about 200 US legal research questions. Four AI products, Alexi, Counsel Stack, Midpage and ChatGPT, scored 74% to 78% overall against 69% for a group of practicing lawyers. Each question was asked once with no follow-up, and some vendors chose not to take part.

    vals.ai

    Credit

    Vals AI

Watch for

  1. Checking that citations support claims

    Thomson Reuters says a new feature, Deep Research Verify, checks whether the Westlaw and Practical Law authorities cited in an AI research report support the specific legal statements they are cited for. The announcement gives no accuracy figures and names no outside test.

    Achieved whenan outside tester measures how often it misses a citation that does not support its statement.

    thomsonreuters.com

    Claimed by

    Thomson Reuters, August 2026

Open

  1. 01

    A free pin-cite checker

    A free tool that reads a brief, finds each pin cite, and checks the quote or point against that page of the printed law report. A pin cite gives the exact page: "1 F.3d 1, 5" means volume 1 of the Federal Reporter, Third Series, a case that starts on page 1, and a point made on page 5.

    The brief
    Credit · unclaimed
  2. 02

    A register of struck-down laws

    For one US state, a public list of every statute that its supreme court or the US Supreme Court has held unconstitutional or blocked, with the decision, the year, and whether the statute is still printed in the state's code. Laws that stay on the books after they can no longer be enforced are often called zombie laws. The register records what courts held and gives no advice.

    The brief
    Credit · unclaimed

Open 01 · the brief

A free pin-cite checker

Credit · unclaimed

The first to publish is credited on this line, and the deliverable moves from Open to Achieved.

What to build

A free tool that reads a brief, finds each pin cite, and checks the quote or point against that page of the printed law report. A pin cite gives the exact page: "1 F.3d 1, 5" means volume 1 of the Federal Reporter, Third Series, a case that starts on page 1, and a point made on page 5.

Why it is still open

In a 2026 Princeton benchmark of 1,300 brief excerpts with planted errors, an AI agent built on GPT-5 caught every made-up case but only 18.2% of wrong page numbers. The authors put this down to missing data, not model ability: official page numbers are often absent from free databases. Free Law Project's citation lookup matches a citation to a real case, and its announcement does not say it checks pages or quotes. I found no free pin-cite checker.

blog.citp.princeton.edufree.law

Built with what exists

The Caselaw Access Project's free case files, whose web versions mark where each printed page begins (for example "2" and "3" in 1 F.3d 1, checked in this session); eyecite and the CourtListener citation lookup API, both from Free Law Project; a language model such as Claude or GPT-5 to compare each quote or point with the page text.

static.case.law

  1. First step

    Download the case files for one reporter series, write a function that returns the text of a given printed page, and test it by hand on 50 pin cites from one published appeal brief.

  2. Done looks like

    On 500 pin cites to cases in the Caselaw Access Project, half correct and half with a planted wrong page, the tool finds at least 80% of the wrong pages and wrongly flags fewer than 5% of the correct ones, with a person checking every result. The published agent's rate of 18.2% is the number to beat.

Open 02 · the brief

A register of struck-down laws

Credit · unclaimed

The first to publish is credited on this line, and the deliverable moves from Open to Achieved.

What to build

For one US state, a public list of every statute that its supreme court or the US Supreme Court has held unconstitutional or blocked, with the decision, the year, and whether the statute is still printed in the state's code. Laws that stay on the books after they can no longer be enforced are often called zombie laws. The register records what courts held and gives no advice.

Why it is still open

Counts of zombie laws come one topic at a time, from journalists and advocacy groups. In April 2024 Arizona's Supreme Court held that an 1864 abortion ban, long unenforced but still on the books, was operative. I found no state-wide register that covers every topic.

statecourtreport.org

Built with what exists

CourtListener's search API for court decisions; the state legislature's published code; eyecite to find statute citations inside opinions; a language model to read each decision and say whether it struck a statute down, with a person checking every row.

  1. First step

    Pull the state supreme court's opinions that use the word "unconstitutional" from CourtListener and hand-check the first 50.

  2. Done looks like

    One state complete for decisions since 1960, each row linked to the decision and to the code section, and a second person agreeing with 95 of 100 rows chosen at random.