BRENNEN

Industries / Transport and vehicles / Aerospace and defense / Defense contracting

Training and simulation

Companies build simulators for armed forces, link them so crews can train together, and in some countries run whole training schools under contract.

6

Milestones achieved, from 1983 to 2021.

1

To watch for: announced, not yet confirmed outside.

2

Open deliverables. Nobody has shipped them.

The road

AchievedWatch forOpen

Achieved

  1. 1983

    Cheap simulators, networked together

    Until about 1983 a military simulator was a stand-alone machine for one crew, costing US$1 million to US$50 million, often more than the vehicle it copied. In 1983 Air Force Lieutenant Colonel Jack Thorpe of DARPA, the Pentagon's research agency, started SIMNET (simulator networking) with consultant Gary Bloedorn. It used simulators of about US$250,000 each, built to "selective fidelity", meaning just good enough for the training goal, and linked hundreds of them so whole units could train in one shared electronic world. Thorpe put the cost of the test network at about US$60 million in 1989, US$20 million of it from DARPA and the rest from the Army.

    Lessona simulator only has to be as real as the skill being trained needs.

    informs-sim.orgairandspaceforces.com

    Credit

    Jack Thorpe and Gary Bloedorn, DARPA

  2. 1995

    A shared language for simulators

    SIMNET's network messages grew into Distributed Interactive Simulation (DIS), published by the IEEE as standard 1278.1 in 1995. DIS fixes the format of about 29 message types, called protocol data units, that simulators from different makers send each other, so a tank simulator from one company can see an aircraft simulator from another. A 1996 paper by Deb Fullford of MaK Technologies, a company that sells DIS software, says DIS compliance had become mandatory for all new training devices the US Department of Defense bought, and that over 50 organizations networked their simulators at a yearly demonstration at the I/ITSEC training conference.

    informs-sim.org

    Credit

    IEEE, building on SIMNET

  3. 1996

    One rulebook for all simulations

    In September 1996 Paul Kaminski, the Pentagon's under secretary for acquisition and technology, ordered that all future US defense simulation programs follow the High Level Architecture (HLA), a set of rules and interfaces that lets separately built simulations join one exercise. Existing programs had to comply or be phased out by the first day of fiscal year 2001. The Pentagon's Architecture Management Group drafted it over 18 months under the Defense Modeling and Simulation Office, and in 2000 it was going through IEEE approval as standard 1516.

    nextgov.comsecwww.jhuapl.edu

    Credit

    Defense Modeling and Simulation Office; Paul Kaminski

  4. 1996

    A company trains NATO pilots

    Canada could not afford about C$700 million to replace its training aircraft. Bombardier made an unsolicited offer in December 1994, and in 1996 Canada's Cabinet approved a 20-year, C$2.8 billion contract with Bombardier, without competition, for NATO Flying Training in Canada. Bombardier supplied and maintained the aircraft, simulators and classroom systems; Canada's Department of National Defence supplied instructors and students; other NATO countries bought places for their own student pilots. Delays in aircraft delivery meant Bombardier could not start training on time, while Canada's lease payments could not be stopped, and by the Auditor General's 2002 audit the department had paid about C$65 million for training it had not received.

    Lessonwhen a contract's payments cannot be paused, a supplier's delay becomes the buyer's loss.

    ourcommons.ca

    Credit

    Bombardier; Department of National Defence, Canada

  5. 2019

    Courses cancelled on both sides

    The UK Ministry of Defence contracted Ascent Flight Training in 2008 to design and introduce a new Military Flying Training System for the middle phase of aircrew training. In 2019 the National Audit Office (NAO) found that 44 of 369 planned courses had been cancelled because one side failed its part: 28 because of the ministry, for example too few air traffic controllers or a runway under repair, and others because of instructor shortfalls or too few aircraft. RAF fast-jet pilots were taking an average of 7.1 years to train against an optimum of 3.9 years. Neither the ministry nor Ascent could easily produce a full list of delayed courses with their causes.

    Lessonwhen buyer and contractor each supply part of a training system, someone has to keep one record of what failed and why.

    nao.org.uknao.org.uk

    Credit

    National Audit Office

  6. 2021

    Half the time, lower scores

    The US Air Force tried a prototype aircraft maintenance course taught with augmented and virtual reality (AR/VR), headsets that overlay or replace what the student sees. Researchers from the Air Force and Aptima, a training research company, compared it with the usual course of lectures and hands-on practice stations. Students in the AR/VR course finished in half the time but scored slightly lower on knowledge and skill tests.

    Lessona shorter course is a gain only once the skill it produces has been measured.

    link.springer.com

    Credit

    US Air Force (Randolph Air Force Base) and Aptima

Watch for

  1. Mixed reality in jet training

    Ascent says it has upgraded 11 training devices for the RAF's Hawk and Texan training aircraft with Varjo mixed reality headsets, which show the outside view while letting the student see the real cockpit and their own hands. It says the devices take 10 to 20% of the floor space of older dome simulators and cost about 10% as much to build, and that analysis by 22 Group, part of the RAF, anticipates up to two more pilots a year for the front line, up to £4 million a year saved on outsourced training, and about £28 million saved over the contract.

    Achieved whenthe Ministry of Defence or the NAO publishes measured pilot output, re-flown sorties or costs from at least one full training year with the new devices.

    ascentflighttraining.com

    Claimed by

    Ascent Flight Training, April 2026

Open

  1. 01

    Instructor grades for public flights

    Grades from qualified flight instructors for maneuvers in the Maneuver ID data, thousands of simulator flights flown by US Air Force student pilots in the Pilot Training Next program and released for public research, plus an automatic grader tested against those grades.

    The brief
    Credit · unclaimed
  2. 02

    Log every cancelled training course

    An open record format and a small tool in which a training buyer and a training contractor both log each planned course, whether it ran, and the cause of any cancellation or delay, coded to the side responsible, with monthly tallies produced automatically.

    The brief
    Credit · unclaimed

Open 01 · the brief

Instructor grades for public flights

Credit · unclaimed

The first to publish is credited on this line, and the deliverable moves from Open to Achieved.

What to build

Grades from qualified flight instructors for maneuvers in the Maneuver ID data, thousands of simulator flights flown by US Air Force student pilots in the Pilot Training Next program and released for public research, plus an automatic grader tested against those grades.

Why it is still open

The dataset's authors say its records lack the quality of each maneuver (unsatisfactory, fair, good or excellent) and the start and stop times of maneuvers, so nobody can yet check a computer's grade against an instructor's on this data. Starter code released with the challenge identifies maneuvers but does not grade them. Automatic graders exist on private data: a 2022 US patent by Alex Rolinski and Brandon Marsell scores maneuvers from flight-recorder data against FAA standards, and in 2025 Lockheed Martin engineers described an open-source language-model instructor that grades simulator runs against limits drawn from manuals, but said comparison with instructor evaluations had only begun. An AIAA paper from June 2026 by Luis Alarcon-Aneiva and Nicoletta Fala describes language-model feedback on maneuvers; its abstract could not be read for this file.

arxiv.orgpatents.google.coms3.amazonaws.com

Built with what exists

The Maneuver ID recordings (from Maneuver-ID.mit.edu after signing its data-sharing agreement); the challenge's starter code on GitHub (Maneuver-Identification); Python and pandas; a time-series classifier or a language model reading the flight track; the FAA's published Airman Certification Standards as the grading guide for basic maneuvers such as steep turns.

  1. First step

    Sign the data agreement, cut out 50 steep turns, and have two instructors grade them without seeing each other's grades.

  2. Done looks like

    500 maneuver segments each graded blind by three instructors, and a grader whose agreement with the instructors' majority grade, measured by Cohen's kappa, is at least as high as the instructors' agreement with each other, with grades and code published.

Open 02 · the brief

Log every cancelled training course

Credit · unclaimed

The first to publish is credited on this line, and the deliverable moves from Open to Achieved.

What to build

An open record format and a small tool in which a training buyer and a training contractor both log each planned course, whether it ran, and the cause of any cancellation or delay, coded to the side responsible, with monthly tallies produced automatically.

Why it is still open

The NAO found that neither the UK Ministry of Defence nor its contractor could easily list delayed courses with their causes, and that the ministry did not collect data across commands on how long students took to finish training. A search of GitHub found flight-school booking apps and an unofficial cadet training record, but no shared, cause-coded course log. This file did not check whether the ministry and Ascent have since built one for their own use.

nao.org.uk

Built with what exists

A CSV or JSON Schema record format; SQLite and Datasette to publish tallies; a small web form in Python; optionally a language model to sort free-text delay notes into the cause list, checked by a person.

  1. First step

    Turn the causes named in the NAO report (air traffic controllers, runway works, instructors, aircraft availability, students not provided) into a code list and a one-page CSV template.

  2. Done looks like

    Replaying a synthetic year built from the NAO's published 2019 figures (369 courses, 44 cancelled, 28 for ministry causes) reproduces those counts automatically, and one real training provider, such as a flying club, runs the log for three months and publishes its cause tally.