Industries / Industrial equipment and services / Testing, inspection and certification
Certifying management systems
Certification bodies send auditors to check that a company runs its work by a written management system standard, for quality, the environment, safety, food safety or AI, then issue a certificate and come back to re-check it.
6
Milestones achieved, from 1996 to 2026.
2
To watch for: announced, not yet confirmed outside.
2
Open deliverables. Nobody has shipped them.
The road
AchievedWatch forOpen
Achieved
1996
Environmental systems get audited
ISO published ISO 14001 in September 1996, its standard for environmental management systems: the written procedures, records and internal checks a company uses to control its effect on the environment. It gave certification bodies a second management system to audit and certify beside quality.
Credit
ISO technical committee ISO/TC 207/SC 1
2000
One benchmark for food audits
The Global Food Safety Initiative (GFSI) was launched in May 2000, after a run of contamination scares and recalls in the 1990s. GFSI does not audit: it compares private food safety certification schemes with its own benchmark, so that a supplier certified to one recognized scheme can satisfy many buyers, "once certified, recognised everywhere" in GFSI's words. The first four schemes it benchmarked were SQF, BRC, IFS and Dutch HACCP, and in February 2008 Walmart began requiring suppliers of its private-label and other foods sold in the US to be certified to a GFSI-benchmarked scheme.
Credit
GFSI, managed by The Consumer Goods Forum
2009
Superior rating, then salmonella
In 2008 AIB, a private audit firm paid by Peanut Corporation of America, rated the company's plant at Plainview, Texas, "superior". Salmonella traced to the company's peanut products then sickened 714 people in 46 states by 20 April 2009, by CDC's count, and may have contributed to nine deaths. At a House hearing in March 2009, Representative Bart Stupak said "there is an obvious and inherent conflict of interest when an auditor works for the same supplier it is evaluating".
Lessona supplier-paid audit gave a top grade while the private labs that had found salmonella in the company's products reported it only to the company.
Credit
US House Energy and Commerce investigations subcommittee; CDC
2018
Safety standard replaces OHSAS
ISO published ISO 45001 in March 2018, a standard for occupational health and safety management systems. ISO says it replaces OHSAS 18001, the British standard against which certification bodies had certified workplace safety systems, and puts more weight on leadership and on improving safety performance.
Credit
ISO/TC 283
2020
Audits move to video
When lockdowns stopped auditors travelling in 2020, certification bodies switched most on-site audits to remote ones, using rules the International Accreditation Forum (IAF) already had for extraordinary events (IAF ID 3:2011) and for audits by video and other information technology (IAF MD 4:2018), by the account of Marcus Long, chief executive of the certification bodies' association IIOC. Food schemes later wrote limits into their benchmark: GFSI's 2024 requirements say at least part of every annual full audit must be on site, including a physical check of good manufacturing practice.
Lessonremote audits kept certificates going through a crisis, but food schemes then required someone to see the plant in person.
Credit
IAF; IIOC; GFSI
2026
Quality standard rewritten
ISO published the sixth edition of ISO 9001 on 16 September 2026, replacing the 2015 edition; ISO counts more than one million ISO 9001 certificates issued to organizations in 189 countries. The new edition puts more weight on quality culture and leadership and treats risks and opportunities separately.
Credit
ISO/TC 176/SC 2
Watch for
Unannounced audits score higher
IFS, which owns the IFS Food certification scheme, says its internal analyses show that unannounced IFS Food audits score better on average than announced ones. Its GFSI-recognized standards require an unannounced audit at least once every three audits; any more are the site's choice.
Achieved whenan outside party compares announced and unannounced audits at the same sites, publishes its method, and finds the same.
Claimed by
IFS, March 2026
Survey counts from one register
The ISO Survey has counted valid certificates to ISO management system standards every year since 1993. ISO says that from 2025 it will be compiled directly from anonymized data in IAF CertSearch, the database of accredited certificates, which it calls the source with "the most complete, up-to-date results".
Achieved whenthe first Survey built from CertSearch is published with counts by standard and country and an estimate of the certificates missing from the register.
Claimed by
ISO, on its ISO Survey page, read November 2026
Open
01
An audit with known answers
A public test of certification audits. It holds the complete evidence for a made-up manufacturer: its quality manual and procedures, twelve months of records, a filmed walk through a workshop and recorded interviews with volunteers playing staff. Three qualified lead auditors plant 30 nonconformities against ISO 9001:2026 in it and grade each one major or minor. A scoring script counts what each human auditor or AI agent finds, misses and invents.
The briefCredit · unclaimed02
Unannounced audits, same sites
An independent comparison of announced and unannounced food safety certification audits at the same sites. For each site with at least one audit of each kind, compare the number of major and minor nonconformities and the grade, so that good sites choosing extra unannounced audits cannot tilt the result.
The briefCredit · unclaimed
Open 01 · the brief
An audit with known answers
The first to publish is credited on this line, and the deliverable moves from Open to Achieved.
What to build
A public test of certification audits. It holds the complete evidence for a made-up manufacturer: its quality manual and procedures, twelve months of records, a filmed walk through a workshop and recorded interviews with volunteers playing staff. Three qualified lead auditors plant 30 nonconformities against ISO 9001:2026 in it and grade each one major or minor. A scoring script counts what each human auditor or AI agent finds, misses and invents.
Why it is still open
AI audit assistants already exist, but none publishes a measured hit rate. DigiAuditor, an open-source "AI-powered audit co-pilot" for ISO 9001 and ISO 14001, appeared on GitHub in May 2026, and Nemko advertises "earlier detection of nonconformities" from AI auditing without figures. Tests with planted errors exist for the text of draft standards, but no public set of audit evidence with known answers was found.
Built with what exists
Documents and records written by hand and with a language model; a phone or 360-degree camera for the site walk; an open speech-to-text model such as Whisper for the interviews; Claude or open-weight models such as Mistral Large 4 (see the Note "A trillion open parameters") as audit agents; a Python script that matches each finding to the answer key by clause and evidence.
First step
Write the made-up company's quality manual and 20 records, plant the first ten nonconformities, and ask one lead auditor to confirm that each is a real nonconformity.
Done looks like
The evidence pack and answer key published under an open licence; at least five human lead auditors and five AI setups audit it without seeing the key; for each, the number of planted nonconformities found and missed and the number of false findings, published with the code.
Open 02 · the brief
Unannounced audits, same sites
The first to publish is credited on this line, and the deliverable moves from Open to Achieved.
What to build
An independent comparison of announced and unannounced food safety certification audits at the same sites. For each site with at least one audit of each kind, compare the number of major and minor nonconformities and the grade, so that good sites choosing extra unannounced audits cannot tilt the result.
Why it is still open
IFS says unannounced IFS Food audits score better on average, from its own analyses, but beyond the required one in three audits sites choose whether to go unannounced. Government inspections point the other way: in a study of 5,550 inspections of 757 Finnish meat, fish and dairy plants from 2016 to 2019, 50.6% of announced inspections earned the top grade against 37.8% of unannounced ones. No published site-by-site comparison of private certification audits was found.
Built with what exists
Anonymized audit results from a scheme owner such as IFS, BRCGS or SQFI, or from a large certification body; GFSI's 2024 rule that reports, certificates and grades must show whether an audit was unannounced; a pre-registered analysis plan on the Open Science Framework; Python with statsmodels for a within-site comparison.
First step
Post the pre-registration and send it to IFS with a request for anonymized data, citing its March 2026 post.
Done looks like
A pre-registered analysis of at least 1,000 sites that had both kinds of audit, with the difference in major nonconformities per audit and its confidence interval, published with the code.