BRENNEN

Industries / Industrial equipment and services / Testing, inspection and certification

Certifying management systems

Certification bodies send auditors to check that a company runs its work by a written management system standard, for quality, the environment, safety, food safety or AI, then issue a certificate and come back to re-check it.

6

Milestones achieved, from 1996 to 2026.

2

To watch for: announced, not yet confirmed outside.

2

Open deliverables. Nobody has shipped them.

The road

AchievedWatch forOpen

Achieved

  1. 1996

    Environmental systems get audited

    ISO published ISO 14001 in September 1996, its standard for environmental management systems: the written procedures, records and internal checks a company uses to control its effect on the environment. It gave certification bodies a second management system to audit and certify beside quality.

    iso.org

    Credit

    ISO technical committee ISO/TC 207/SC 1

  2. 2000

    One benchmark for food audits

    The Global Food Safety Initiative (GFSI) was launched in May 2000, after a run of contamination scares and recalls in the 1990s. GFSI does not audit: it compares private food safety certification schemes with its own benchmark, so that a supplier certified to one recognized scheme can satisfy many buyers, "once certified, recognised everywhere" in GFSI's words. The first four schemes it benchmarked were SQF, BRC, IFS and Dutch HACCP, and in February 2008 Walmart began requiring suppliers of its private-label and other foods sold in the US to be certified to a GFSI-benchmarked scheme.

    foodengineeringmag.commygfsi.comfoodsafetynews.com

    Credit

    GFSI, managed by The Consumer Goods Forum

  3. 2009

    Superior rating, then salmonella

    In 2008 AIB, a private audit firm paid by Peanut Corporation of America, rated the company's plant at Plainview, Texas, "superior". Salmonella traced to the company's peanut products then sickened 714 people in 46 states by 20 April 2009, by CDC's count, and may have contributed to nine deaths. At a House hearing in March 2009, Representative Bart Stupak said "there is an obvious and inherent conflict of interest when an auditor works for the same supplier it is evaluating".

    Lessona supplier-paid audit gave a top grade while the private labs that had found salmonella in the company's products reported it only to the company.

    heraldnet.comarchive.cdc.govgovinfo.gov

    Credit

    US House Energy and Commerce investigations subcommittee; CDC

  4. 2018

    Safety standard replaces OHSAS

    ISO published ISO 45001 in March 2018, a standard for occupational health and safety management systems. ISO says it replaces OHSAS 18001, the British standard against which certification bodies had certified workplace safety systems, and puts more weight on leadership and on improving safety performance.

    iso.org

    Credit

    ISO/TC 283

  5. 2020

    Audits move to video

    When lockdowns stopped auditors travelling in 2020, certification bodies switched most on-site audits to remote ones, using rules the International Accreditation Forum (IAF) already had for extraordinary events (IAF ID 3:2011) and for audits by video and other information technology (IAF MD 4:2018), by the account of Marcus Long, chief executive of the certification bodies' association IIOC. Food schemes later wrote limits into their benchmark: GFSI's 2024 requirements say at least part of every annual full audit must be on site, including a physical check of good manufacturing practice.

    Lessonremote audits kept certificates going through a crisis, but food schemes then required someone to see the plant in person.

    iaf.newsmygfsi.com

    Credit

    IAF; IIOC; GFSI

  6. 2026

    Quality standard rewritten

    ISO published the sixth edition of ISO 9001 on 16 September 2026, replacing the 2015 edition; ISO counts more than one million ISO 9001 certificates issued to organizations in 189 countries. The new edition puts more weight on quality culture and leadership and treats risks and opportunities separately.

    iso.orglrqa.com

    Credit

    ISO/TC 176/SC 2

Watch for

  1. Unannounced audits score higher

    IFS, which owns the IFS Food certification scheme, says its internal analyses show that unannounced IFS Food audits score better on average than announced ones. Its GFSI-recognized standards require an unannounced audit at least once every three audits; any more are the site's choice.

    Achieved whenan outside party compares announced and unannounced audits at the same sites, publishes its method, and finds the same.

    ifs-certification.com

    Claimed by

    IFS, March 2026

  2. Survey counts from one register

    The ISO Survey has counted valid certificates to ISO management system standards every year since 1993. ISO says that from 2025 it will be compiled directly from anonymized data in IAF CertSearch, the database of accredited certificates, which it calls the source with "the most complete, up-to-date results".

    Achieved whenthe first Survey built from CertSearch is published with counts by standard and country and an estimate of the certificates missing from the register.

    iso.org

    Claimed by

    ISO, on its ISO Survey page, read November 2026

Open

  1. 01

    An audit with known answers

    A public test of certification audits. It holds the complete evidence for a made-up manufacturer: its quality manual and procedures, twelve months of records, a filmed walk through a workshop and recorded interviews with volunteers playing staff. Three qualified lead auditors plant 30 nonconformities against ISO 9001:2026 in it and grade each one major or minor. A scoring script counts what each human auditor or AI agent finds, misses and invents.

    The brief
    Credit · unclaimed
  2. 02

    Unannounced audits, same sites

    An independent comparison of announced and unannounced food safety certification audits at the same sites. For each site with at least one audit of each kind, compare the number of major and minor nonconformities and the grade, so that good sites choosing extra unannounced audits cannot tilt the result.

    The brief
    Credit · unclaimed

Open 01 · the brief

An audit with known answers

Credit · unclaimed

The first to publish is credited on this line, and the deliverable moves from Open to Achieved.

What to build

A public test of certification audits. It holds the complete evidence for a made-up manufacturer: its quality manual and procedures, twelve months of records, a filmed walk through a workshop and recorded interviews with volunteers playing staff. Three qualified lead auditors plant 30 nonconformities against ISO 9001:2026 in it and grade each one major or minor. A scoring script counts what each human auditor or AI agent finds, misses and invents.

Why it is still open

AI audit assistants already exist, but none publishes a measured hit rate. DigiAuditor, an open-source "AI-powered audit co-pilot" for ISO 9001 and ISO 14001, appeared on GitHub in May 2026, and Nemko advertises "earlier detection of nonconformities" from AI auditing without figures. Tests with planted errors exist for the text of draft standards, but no public set of audit evidence with known answers was found.

github.comdigital.nemko.com

Built with what exists

Documents and records written by hand and with a language model; a phone or 360-degree camera for the site walk; an open speech-to-text model such as Whisper for the interviews; Claude or open-weight models such as Mistral Large 4 (see the Note "A trillion open parameters") as audit agents; a Python script that matches each finding to the answer key by clause and evidence.

  1. First step

    Write the made-up company's quality manual and 20 records, plant the first ten nonconformities, and ask one lead auditor to confirm that each is a real nonconformity.

  2. Done looks like

    The evidence pack and answer key published under an open licence; at least five human lead auditors and five AI setups audit it without seeing the key; for each, the number of planted nonconformities found and missed and the number of false findings, published with the code.

Open 02 · the brief

Unannounced audits, same sites

Credit · unclaimed

The first to publish is credited on this line, and the deliverable moves from Open to Achieved.

What to build

An independent comparison of announced and unannounced food safety certification audits at the same sites. For each site with at least one audit of each kind, compare the number of major and minor nonconformities and the grade, so that good sites choosing extra unannounced audits cannot tilt the result.

Why it is still open

IFS says unannounced IFS Food audits score better on average, from its own analyses, but beyond the required one in three audits sites choose whether to go unannounced. Government inspections point the other way: in a study of 5,550 inspections of 757 Finnish meat, fish and dairy plants from 2016 to 2019, 50.6% of announced inspections earned the top grade against 37.8% of unannounced ones. No published site-by-site comparison of private certification audits was found.

ifs-certification.comnature.com

Built with what exists

Anonymized audit results from a scheme owner such as IFS, BRCGS or SQFI, or from a large certification body; GFSI's 2024 rule that reports, certificates and grades must show whether an audit was unannounced; a pre-registered analysis plan on the Open Science Framework; Python with statsmodels for a within-site comparison.

  1. First step

    Post the pre-registration and send it to IFS with a request for anonymized data, citing its March 2026 post.

  2. Done looks like

    A pre-registered analysis of at least 1,000 sites that had both kinds of audit, with the difference in major nonconformities per audit and its confidence interval, published with the code.