Industries / Government, education and community / Government
Records and identity
Keeping the official record of who people are and what happened to them, from births, deaths and censuses to identity cards and online sign-in, and letting the public see the government's own records.
7
Milestones achieved, from 1766 to 2023.
1
To watch for: announced, not yet confirmed outside.
2
Open deliverables. Nobody has shipped them.
The road
AchievedWatch forOpen
Achieved
1766
A right to see records
Sweden's Freedom of the Press Act of 2 December 1766 abolished censorship and gave citizens a right to the government's archives: its Article 10 said "free access should be allowed to all archives". The Library of Congress calls it the first act to establish access to public documents for a country's citizens. It lost its constitutional standing when King Gustav III took power in 1772 and regained it in the constitution of 1809.
LessonA right of access lasts only as long as the law that protects it.
Credit
the Riksdag (parliament) of Sweden; Anders Chydenius, a priest and member of parliament who has been described as its author
1890
A census counted by machine
The US Census Office used Herman Hollerith's electric tabulators, which counted holes punched in cards, after his system beat two rivals in an 1888 contest: it sorted test data from St. Louis in 5.5 hours, against 44.5 and 55.5. Clerks tabulated returns for nearly 63 million people, and the Census Bureau says it published the 1890 results 18 months sooner than those of 1880. Improved versions stayed in use until the UNIVAC I computer began replacing them in 1951.
Credit
Herman Hollerith; US Census Office
1921
The 1890 schedules burn
A fire in the basement of the Commerce Department building in Washington on 10 January 1921 destroyed or damaged most of the 1890 population schedules, the original household returns. Records from 1830, 1840, 1880, 1900 and 1910, kept in a fireproof vault in the same basement, mostly survived. In 1933 Congress authorized the disposal of what could not be saved.
LessonA record kept in one copy, in one place, can be lost for good.
Credit
US Census Bureau, the custodian
2001
Agencies query each other online
Estonia began the national deployment of X-Road on 17 December 2001: software through which separate government databases ask each other for data over the internet, with the traffic signed, encrypted and logged. Estonian police, for example, check a driver's license in the transport register through it, so drivers need not carry the card. Finland agreed in 2013 to develop it jointly, and the two countries published the core code as open source in 2015 and 2016.
Credit
Estonia's State Information Systems Department; AS Assert and Cybernetica, which built it
2022
A billion IDs audited
India's Unique Identification Authority (UIDAI) had issued 1.32 billion Aadhaar numbers, India's biometric identity number, by 31 October 2021. In its first performance audit of the authority, dated 6 April 2022, the Comptroller and Auditor General of India found that UIDAI had cancelled more than 475,000 Aadhaar numbers as duplicates by November 2019, and that over 73% of the 30.4 million biometric updates in 2018–19 were residents paying to fix poor biometric records.
LessonAn identity number is only unique if the biometrics captured at enrollment are good enough to tell people apart.
Credit
UIDAI, which runs the system; the Comptroller and Auditor General of India, which audited it
2023
A sign-in that fell short
The inspector general of the US General Services Administration (GSA) found that GSA told the agencies using Login.gov, the federal government's sign-in service, that it met the identity-proofing level called IAL2 in the National Institute of Standards and Technology's (NIST) Digital Identity Guidelines, although Login.gov "has never included a physical or biometric comparison". GSA had billed those agencies over $10 million, including for services that did not meet the standard, and agreed with the findings.
LessonA claim to meet an identity standard needs checking by someone other than the service that makes it.
Credit
GSA Office of Inspector General, report JE23-003
2023
Records linked to wrong people
An interim government report on Japan's My Number identity system, released in August 2023, found more than 1,000 cases in which health insurers had linked a person's insurance record to someone else's My Number, and that about 20% of local governments surveyed had followed the wrong procedure when linking disability records.
LessonJoining records across agencies needs a check that each link is the right person.
Credit
Government of Japan, as reported by The Japan Times
Watch for
Identity wallets across the EU
Regulation (EU) 2024/1183 requires each EU member state to offer its citizens, residents and businesses at least one European Digital Identity Wallet, a phone app that holds a national ID and other proofs such as a driving license or diploma, by the end of 2026; Namirial, an identity company, gives the date as 24 December 2026, with regulated services required to accept the wallet a year later. In its review for the first quarter of 2026, Namirial rated three member states almost certain to meet the date, five very likely, eight likely, seven "might" and four unlikely.
Achieved whenall 27 member states offer a wallet built to the common specifications, and wallets from one state are accepted in the others.
Claimed by
European Commission, January 2026
Open
01
A redaction test for records
A public test of the tools that black out personal details before records are released under freedom-of-information (FOI) laws: a few hundred made-up records, such as letters, emails, case notes and forms, some of them scanned, with every name, address, phone number and ID number marked, and a score for each tool on what it misses, what it blacks out without need, and whether the hidden text can still be copied out of the released file.
The briefCredit · unclaimed02
Count questions asked twice
An audit of one US state's public forms: every question on the forms of its largest agencies, such as motor vehicles, benefits, taxes and licensing, listed and marked where it asks for something another agency of the same state already records, such as an address the motor vehicle agency holds.
The briefCredit · unclaimed
Open 01 · the brief
A redaction test for records
The first to publish is credited on this line, and the deliverable moves from Open to Achieved.
What to build
A public test of the tools that black out personal details before records are released under freedom-of-information (FOI) laws: a few hundred made-up records, such as letters, emails, case notes and forms, some of them scanned, with every name, address, phone number and ID number marked, and a score for each tool on what it misses, what it blacks out without need, and whether the hidden text can still be copied out of the released file.
Why it is still open
In a 2025 study of 44 UK public authorities answering FOI requests, only one reported using AI tools for redaction, and half said they held no formal redaction policy. In searches of research papers and GitHub I found redaction tools and tests built on court decisions and AI training data, but no public test set of the mixed, partly scanned files an FOI office releases.
Built with what exists
Presidio, an open-source tool that finds and masks personal data in text and images; AI models that read scanned pages; pdftotext or a similar tool to see whether text survives under a black box; AI models to write the made-up records from templates.
First step
Write 50 made-up council letters and emails, mark every personal detail in them, and score Presidio on the set.
Done looks like
500 made-up records holding at least 5,000 marked items, five tools scored on missed items, needless redactions and leaked hidden text, and the records and scoring code published.
Open 02 · the brief
Count questions asked twice
The first to publish is credited on this line, and the deliverable moves from Open to Achieved.
What to build
An audit of one US state's public forms: every question on the forms of its largest agencies, such as motor vehicles, benefits, taxes and licensing, listed and marked where it asks for something another agency of the same state already records, such as an address the motor vehicle agency holds.
Why it is still open
The EU's Single Digital Gateway Regulation of October 2018 sets up a system for authorities in different member states to exchange evidence directly, under a "once-only" rule for the procedures it lists, so that people need not hand the same documents over again. I found no published count, for any US state, of how many form questions ask for data the state already holds.
Built with what exists
pypdf or a similar library to read the fields of fillable PDF forms; AI models that read scanned forms; a fixed list of data types to tag each question with. (see the Note "A thousand questions, one pass")
First step
Download 30 forms from one state's motor vehicle and benefits agencies and list their questions in a spreadsheet.
Done looks like
at least 300 public forms from one state broken into questions and tagged, a second person re-checking a random 10% with the agreement rate reported, and a published count of repeated questions by agency.