Industries / Industrial equipment and services / IoT and industrial automation / Industrial controls and PLCs
Operator screens
Operator screens, called HMIs (human-machine interfaces) in the trade, are the displays and touch panels through which people watch and run machines and processes, built with screen-building software that is sold alongside the controllers.
4
Milestones achieved, from 1984 to 2004.
1
To watch for: announced, not yet confirmed outside.
2
Open deliverables. Nobody has shipped them.
The road
AchievedWatch forOpen
Achieved
1984
Plant graphics on a PC
Intellution, founded in 1981 by Steve Rubin, a former Foxboro engineer, released its FIX software in 1984. Its developers had started on DEC's PDP-11 minicomputer and moved to the IBM PC, where FIX drew process graphics under MS-DOS and ran its communication drivers separately from the graphics. Jeremy Pollard, a columnist for the trade magazine Control Design, writes that Intellution "was the first to penetrate the industrial marketplace" and became the de facto standard for process graphics.
Credit
Steve Rubin, Intellution
1989
Screens move to Windows
Wonderware, incorporated on 1 April 1987 by Dennis Morin, a former Triconex engineer, and colleagues, released InTouch, which Wonderware calls the first HMI software for Microsoft Windows. In 2007 the company said it had "no Windows-based competition until 1993" and counted more than 100,000 plants as customers. Pollard writes that ignoring Windows was Intellution's "biggest mistake" and that Wonderware became "the de facto standard for Windows-based SCADA."
LessonScreen software moved to the operating system that office PCs ran, and the leader that waited lost its place.
Credit
Dennis Morin, Wonderware
1989
Touch panels for machines
A panel HMI is a screen mounted on a machine or cabinet door and wired to its controller, where operators press buttons drawn on the screen. Digital Electronics Corporation of Osaka, under its Pro-face brand, began taking orders for its GP Series panels in November 1988 and delivered them from February 1989. Pro-face calls the GP Series "the world's first HMI," says it was the first to make Ethernet a standard feature of its panels in 2000, and says it had sold more than 5 million HMI units by April 2019.
Credit
Digital Electronics Corporation (Pro-face)
2004
Screen designs put to test
NOVA Chemicals and the Abnormal Situation Management (ASM) Consortium timed console operators at NOVA's Joffre ethylene site in Alberta, Canada, on nine simulated upsets. One group used screens built to the consortium's design, with several linked windows and trends built into the displays, and the other a traditional layout. Operators on the new screens took 10.6 minutes per scenario on average against 18.1, completed 95.5% of scenarios against 70.0%, and spotted the upset early in 47.7% of cases against 10.0%.
Credit
Jamie Errington (Human Centered Solutions), Tim DeMaere and Eric Wade (NOVA Chemicals), and the ASM Consortium
Watch for
Screens drawn from sketches
Beckhoff says TwinCAT 3 CoAgent for Engineering (TE1700), announced on 23 June 2026, works inside its TwinCAT programming software and offers "HMI layouts and design suggestions from sketches" as well as code, with engineers "reviewing and approving every AI-generated result before it is applied." It says that in internal testing and pilot deployments the assistant showed productivity gains of 20 to 30 percent, mainly in getting to know existing code, documentation and maintenance.
Achieved whenan outside team measures the time to build a set of screens, and the errors in them, with and without the assistant.
Claimed by
Beckhoff Automation, June 2026
Open
01
Screens from the drawing
A program that reads a P&ID (piping and instrumentation diagram, the drawing of every pipe, vessel, valve and instrument in a unit) and its tag list, and draws first-draft operator screens in an open HMI, with every symbol placed, labelled and linked to its tag, for an HMI engineer to finish.
The briefCredit · unclaimed02
AI-built screens under test
A study in which operators run a simulated process from two sets of screens for the same plant, one built by an AI assistant from sketches and text and one built by an experienced HMI engineer, measuring how fast and how accurately they complete standard tasks, and how many hours each set took to build.
The briefCredit · unclaimed
Open 01 · the brief
Screens from the drawing
The first to publish is credited on this line, and the deliverable moves from Open to Achieved.
What to build
A program that reads a P&ID (piping and instrumentation diagram, the drawing of every pipe, vessel, valve and instrument in a unit) and its tag list, and draws first-draft operator screens in an open HMI, with every symbol placed, labelled and linked to its tag, for an HMI engineer to finish.
Why it is still open
Rockwell Automation's US patent 12,046,069, granted on 23 July 2024, says engineers "typically create the HMI displays according to the P&ID by manually placing and arranging objects" and that this "can take months or years of manual labor"; the tool it claims extracts symbols only after an engineer marks an example of each type, and it reports no accuracy. Published research stops at reading the drawing: Digitize-PID (2021) detects pipes, symbols and text and released 500 synthetic P&IDs because "currently there exists no public P&ID dataset," and Jan Marius Stürmer, Marius Graumann and Tobias Koch turned P&IDs into graphs in a 2024 study.
Built with what exists
Dataset-P&ID, the Digitize-PID authors' public set; P&IDs in DEXPI, the open exchange format for plant drawings; AI models that read drawings, such as Claude or Gemini; FUXA, an open-source web-based HMI, as the target.
First step
Take 10 sheets from Dataset-P&ID, have one model list every tagged item with its position, and score the list against the annotations.
Done looks like
On 50 P&ID sheets, at least 95% of tagged instruments and equipment appear on the generated screens linked to the right tag, checked against the drawings' annotations, with an HMI engineer's time to finish each screen published beside the time to build it from scratch.
Open 02 · the brief
AI-built screens under test
The first to publish is credited on this line, and the deliverable moves from Open to Achieved.
What to build
A study in which operators run a simulated process from two sets of screens for the same plant, one built by an AI assistant from sketches and text and one built by an experienced HMI engineer, measuring how fast and how accurately they complete standard tasks, and how many hours each set took to build.
Why it is still open
Beckhoff's 20 to 30 percent figure comes from its own tests and pilots and measures engineering work, not how well operators use the result. After the 2008 explosion at Bayer CropScience in Institute, West Virginia, the US Chemical Safety Board found that new screens had made data entry "much slower" and degraded operators' awareness, so screen quality shows up in operation, not only in build time. Searches of arXiv and OpenAlex in November 2026 found no published comparison of AI-built and hand-built industrial screens.
Built with what exists
an AI assistant that builds screens, such as Beckhoff's TwinCAT CoAgent or a general model writing FUXA screens; FUXA; a simulated process served over OPC UA with open62541; screen recording to time each task.
First step
Build one tank-and-pump screen twice in FUXA, once by a model from a hand sketch and once by hand, and time three colleagues on five tasks with each.
Done looks like
At least 12 people with control-room experience each complete the same 10 tasks on both screen sets in random order, with task times, errors and build hours published for both sets.