Industries / Transport and vehicles / Aerospace and defense / Defense contracting
Training and simulation
Companies build simulators for armed forces, link them so crews can train together, and in some countries run whole training schools under contract.
6
Milestones achieved, from 1983 to 2021.
1
To watch for: announced, not yet confirmed outside.
2
Open deliverables. Nobody has shipped them.
The road
AchievedWatch forOpen
Achieved
1983
Cheap simulators, networked together
Until about 1983 a military simulator was a stand-alone machine for one crew, costing US$1 million to US$50 million, often more than the vehicle it copied. In 1983 Air Force Lieutenant Colonel Jack Thorpe of DARPA, the Pentagon's research agency, started SIMNET (simulator networking) with consultant Gary Bloedorn. It used simulators of about US$250,000 each, built to "selective fidelity", meaning just good enough for the training goal, and linked hundreds of them so whole units could train in one shared electronic world. Thorpe put the cost of the test network at about US$60 million in 1989, US$20 million of it from DARPA and the rest from the Army.
Lessona simulator only has to be as real as the skill being trained needs.
Credit
Jack Thorpe and Gary Bloedorn, DARPA
1995
A shared language for simulators
SIMNET's network messages grew into Distributed Interactive Simulation (DIS), published by the IEEE as standard 1278.1 in 1995. DIS fixes the format of about 29 message types, called protocol data units, that simulators from different makers send each other, so a tank simulator from one company can see an aircraft simulator from another. A 1996 paper by Deb Fullford of MaK Technologies, a company that sells DIS software, says DIS compliance had become mandatory for all new training devices the US Department of Defense bought, and that over 50 organizations networked their simulators at a yearly demonstration at the I/ITSEC training conference.
Credit
IEEE, building on SIMNET
1996
One rulebook for all simulations
In September 1996 Paul Kaminski, the Pentagon's under secretary for acquisition and technology, ordered that all future US defense simulation programs follow the High Level Architecture (HLA), a set of rules and interfaces that lets separately built simulations join one exercise. Existing programs had to comply or be phased out by the first day of fiscal year 2001. The Pentagon's Architecture Management Group drafted it over 18 months under the Defense Modeling and Simulation Office, and in 2000 it was going through IEEE approval as standard 1516.
Credit
Defense Modeling and Simulation Office; Paul Kaminski
1996
A company trains NATO pilots
Canada could not afford about C$700 million to replace its training aircraft. Bombardier made an unsolicited offer in December 1994, and in 1996 Canada's Cabinet approved a 20-year, C$2.8 billion contract with Bombardier, without competition, for NATO Flying Training in Canada. Bombardier supplied and maintained the aircraft, simulators and classroom systems; Canada's Department of National Defence supplied instructors and students; other NATO countries bought places for their own student pilots. Delays in aircraft delivery meant Bombardier could not start training on time, while Canada's lease payments could not be stopped, and by the Auditor General's 2002 audit the department had paid about C$65 million for training it had not received.
Lessonwhen a contract's payments cannot be paused, a supplier's delay becomes the buyer's loss.
Credit
Bombardier; Department of National Defence, Canada
2019
Courses cancelled on both sides
The UK Ministry of Defence contracted Ascent Flight Training in 2008 to design and introduce a new Military Flying Training System for the middle phase of aircrew training. In 2019 the National Audit Office (NAO) found that 44 of 369 planned courses had been cancelled because one side failed its part: 28 because of the ministry, for example too few air traffic controllers or a runway under repair, and others because of instructor shortfalls or too few aircraft. RAF fast-jet pilots were taking an average of 7.1 years to train against an optimum of 3.9 years. Neither the ministry nor Ascent could easily produce a full list of delayed courses with their causes.
Lessonwhen buyer and contractor each supply part of a training system, someone has to keep one record of what failed and why.
Credit
National Audit Office
2021
Half the time, lower scores
The US Air Force tried a prototype aircraft maintenance course taught with augmented and virtual reality (AR/VR), headsets that overlay or replace what the student sees. Researchers from the Air Force and Aptima, a training research company, compared it with the usual course of lectures and hands-on practice stations. Students in the AR/VR course finished in half the time but scored slightly lower on knowledge and skill tests.
Lessona shorter course is a gain only once the skill it produces has been measured.
Credit
US Air Force (Randolph Air Force Base) and Aptima
Watch for
Mixed reality in jet training
Ascent says it has upgraded 11 training devices for the RAF's Hawk and Texan training aircraft with Varjo mixed reality headsets, which show the outside view while letting the student see the real cockpit and their own hands. It says the devices take 10 to 20% of the floor space of older dome simulators and cost about 10% as much to build, and that analysis by 22 Group, part of the RAF, anticipates up to two more pilots a year for the front line, up to £4 million a year saved on outsourced training, and about £28 million saved over the contract.
Achieved whenthe Ministry of Defence or the NAO publishes measured pilot output, re-flown sorties or costs from at least one full training year with the new devices.
Claimed by
Ascent Flight Training, April 2026
Open
01
Instructor grades for public flights
Grades from qualified flight instructors for maneuvers in the Maneuver ID data, thousands of simulator flights flown by US Air Force student pilots in the Pilot Training Next program and released for public research, plus an automatic grader tested against those grades.
The briefCredit · unclaimed02
Log every cancelled training course
An open record format and a small tool in which a training buyer and a training contractor both log each planned course, whether it ran, and the cause of any cancellation or delay, coded to the side responsible, with monthly tallies produced automatically.
The briefCredit · unclaimed
Open 01 · the brief
Instructor grades for public flights
The first to publish is credited on this line, and the deliverable moves from Open to Achieved.
What to build
Grades from qualified flight instructors for maneuvers in the Maneuver ID data, thousands of simulator flights flown by US Air Force student pilots in the Pilot Training Next program and released for public research, plus an automatic grader tested against those grades.
Why it is still open
The dataset's authors say its records lack the quality of each maneuver (unsatisfactory, fair, good or excellent) and the start and stop times of maneuvers, so nobody can yet check a computer's grade against an instructor's on this data. Starter code released with the challenge identifies maneuvers but does not grade them. Automatic graders exist on private data: a 2022 US patent by Alex Rolinski and Brandon Marsell scores maneuvers from flight-recorder data against FAA standards, and in 2025 Lockheed Martin engineers described an open-source language-model instructor that grades simulator runs against limits drawn from manuals, but said comparison with instructor evaluations had only begun. An AIAA paper from June 2026 by Luis Alarcon-Aneiva and Nicoletta Fala describes language-model feedback on maneuvers; its abstract could not be read for this file.
Built with what exists
The Maneuver ID recordings (from Maneuver-ID.mit.edu after signing its data-sharing agreement); the challenge's starter code on GitHub (Maneuver-Identification); Python and pandas; a time-series classifier or a language model reading the flight track; the FAA's published Airman Certification Standards as the grading guide for basic maneuvers such as steep turns.
First step
Sign the data agreement, cut out 50 steep turns, and have two instructors grade them without seeing each other's grades.
Done looks like
500 maneuver segments each graded blind by three instructors, and a grader whose agreement with the instructors' majority grade, measured by Cohen's kappa, is at least as high as the instructors' agreement with each other, with grades and code published.
Open 02 · the brief
Log every cancelled training course
The first to publish is credited on this line, and the deliverable moves from Open to Achieved.
What to build
An open record format and a small tool in which a training buyer and a training contractor both log each planned course, whether it ran, and the cause of any cancellation or delay, coded to the side responsible, with monthly tallies produced automatically.
Why it is still open
The NAO found that neither the UK Ministry of Defence nor its contractor could easily list delayed courses with their causes, and that the ministry did not collect data across commands on how long students took to finish training. A search of GitHub found flight-school booking apps and an unofficial cadet training record, but no shared, cause-coded course log. This file did not check whether the ministry and Ascent have since built one for their own use.
Built with what exists
A CSV or JSON Schema record format; SQLite and Datasette to publish tallies; a small web form in Python; optionally a language model to sort free-text delay notes into the cause list, checked by a person.
First step
Turn the causes named in the NAO report (air traffic controllers, runway works, instructors, aircraft availability, students not provided) into a code list and a one-page CSV template.
Done looks like
Replaying a synthetic year built from the NAO's published 2019 figures (369 courses, 44 cancelled, 28 for ministry causes) reproduces those counts automatically, and one real training provider, such as a flying club, runs the log for three months and publishes its cause tally.