BRENNEN

Industries / Industrial equipment and services / IoT and industrial automation / Digital twins

Building the model

Building the model means making the virtual copy of one particular asset: its shape, its parts and how they connect, taken from drawings, scans and the makers' data.

4

Milestones achieved, from 1998 to 2025.

1

To watch for: announced, not yet confirmed outside.

2

Open deliverables. Nobody has shipped them.

The road

AchievedWatch forOpen

Achieved

  1. 1998

    Lasers record plants as built

    A plant retrofit needs "as-built" drawings, which show what was actually installed rather than what was designed. MIT News reported in September 1998 that the Cyrax laser scanner collects 3D points on a structure and turns them into a computer model in the field, that one person can run it without scaffolding, and that it had won a 1998 R&D 100 Award. By the xyHt magazine history, Cyra Technologies launched it that year as the Cyrax 2400 to deliver "fast, accurate as-builts that are critical to problem-free plant retrofit design and construction", and Chevron, its first test customer, had it demonstrated at its Richmond, California refinery.

    news.mit.eduxyht.comxyht.com

    Credit

    Cyra Technologies, which wrote the modelling software; MIT Lincoln Laboratory, where John Zayhowski's group built the laser transceiver; Los Alamos National Laboratory, which built the timing chip

  2. 2023

    Photos become 3D scenes

    Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler and George Drettakis described 3D Gaussian splatting at SIGGRAPH 2023. It rebuilds a scene from ordinary photos as a cloud of small, coloured, semi-transparent blobs called Gaussians, and the authors report real-time viewing at 100 frames per second or more at 1080p resolution. In March 2026 OpenUSD v26.03 added a schema that stores such splats as a standard object type, with a reference renderer, so a captured scene can sit in the same file as the engineering model.

    repo-sam.inria.fraousd.org

    Credit

    Kerbl, Kopanas, Leimkühler and Drettakis (Inria, Université Côte d'Azur, MPI Informatik); the Alliance for OpenUSD

  3. 2023

    A standard record for machines

    On 14 December 2023 the International Electrotechnical Commission (IEC) published IEC 63278-1, which "defines the structure of a standardized digital representation of an asset, called Asset Administration Shell (AAS)". An AAS gives the data and documents about one machine a fixed structure, so that software from different makers can read them.

    webstore.iec.ch

    Credit

    IEC Technical Committee 65

  4. 2025

    One file format for scenes

    Universal Scene Description (USD) is a file format that builds a 3D scene from many layered files. Pixar open-sourced it in 2016, after proving it on the film Finding Dory. In 2023 Pixar, Adobe, Apple, Autodesk and NVIDIA formed the Alliance for OpenUSD, and on 17 December 2025 the alliance ratified OpenUSD Core Specification 1.0. It covers the grammar and data types, how layers are combined, how values are resolved and the file formats; vocabularies for subjects such as physics and materials are left to later specifications.

    aousd.orgaousd.orgaousd.org

    Credit

    Pixar; the Alliance for OpenUSD

Watch for

  1. Simulations built from phone video

    The RoboSimStudio project says a Claude or Codex coding agent builds a robot simulation's scene, camera and physics from a smartphone video and a one-line prompt "in about an hour", after which people and agents tune the copy until it matches the video. The code is open under the Apache 2.0 license. The project page gives no measured comparison between the copy and the real scene. The Note "Readable robot programs" covers the project.

    Achieved whenan outside group rebuilds at least ten real scenes this way and publishes how far object sizes, positions and task outcomes differ between each copy and its scene.

    robosimstudio.github.io

    Claimed by

    the RoboSimStudio authors at UC Berkeley's AUTOLab (Kaiyuan Chen, Ken Goldberg and others) and NVIDIA (Eric Heiden, Miles Macklin and others), 2026

Open

  1. 01

    Plant rooms from phone scans

    A pipeline that turns a phone or handheld laser scan of a plant room (the room that holds a building's pumps, boilers, pipes, valves and ducts) into an editable building model in IFC, the open file format for building models. Every pipe becomes a pipe object of the right diameter, joined to its neighbours at the fittings, and each object keeps a link to the photos it came from.

    The brief
    Credit · unclaimed
  2. 02

    Piping drawings read into data

    A reader that turns scanned piping and instrumentation diagrams (P&IDs, the drawings that show every pipe, valve and instrument in a process plant and how they connect) into DEXPI files, the open exchange format for P&IDs, together with a public test set of real diagrams with answer keys.

    The brief
    Credit · unclaimed

Open 01 · the brief

Plant rooms from phone scans

Credit · unclaimed

The first to publish is credited on this line, and the deliverable moves from Open to Achieved.

What to build

A pipeline that turns a phone or handheld laser scan of a plant room (the room that holds a building's pumps, boilers, pipes, valves and ducts) into an editable building model in IFC, the open file format for building models. Every pipe becomes a pipe object of the right diameter, joined to its neighbours at the fittings, and each object keeps a link to the photos it came from.

Why it is still open

In October 2025 Fabio Bronzin of the venture firm Foundamental wrote that "Scan-to-BIM remains stubbornly manual", that an automated tool "might detect straight pipe runs well but fail to model the junctions or valves", and that "No off-the-shelf solution today can reliably take an arbitrary building scan and output a complete, production-ready BIM model."

foundamental.com

Built with what exists

an iPhone Pro's LiDAR sensor with a scanning app such as Polycam, or a borrowed handheld laser scanner; COLMAP to work out where each photo was taken; gsplat or Nerfstudio for a Gaussian splat of the room, stored with OpenUSD v26.03's splat schema; Open3D to fit cylinders to the point cloud; Meta's Segment Anything 2 to pick out pipes and valves in the photos; IfcOpenShell, an open-source library, to write the IFC file; a coding agent such as Claude Code to join the steps.

  1. First step

    With a facilities manager's permission, scan one school or university plant room and hand-measure 30 pipes as the answer key.

  2. Done looks like

    Ten plant rooms in different buildings. In each, every pipe of 50 mm diameter or more is found, its centre line lies within 2 cm of a hand survey made with a tape and a laser distance meter, its diameter is within one standard pipe size, at least 90% of joints are connected correctly, and the hours spent per room are recorded. Models, photos and the scoring script are published.

Open 02 · the brief

Piping drawings read into data

Credit · unclaimed

The first to publish is credited on this line, and the deliverable moves from Open to Achieved.

What to build

A reader that turns scanned piping and instrumentation diagrams (P&IDs, the drawings that show every pipe, valve and instrument in a process plant and how they connect) into DEXPI files, the open exchange format for P&IDs, together with a public test set of real diagrams with answer keys.

Why it is still open

The German Aerospace Center (DLR) team behind the PID2Graph dataset writes that earlier work "has mostly been evaluated on private datasets", unpublished because of copyright and intellectual-property concerns. Its own real-world test set holds 12 public diagrams of the OPEN100 reactor design, on which its best model scored 76.79% at finding connections on diagram patches, by the authors' figures.

arxiv.org

Built with what exists

the PID2Graph data on Zenodo and the authors' Relationformer method; pyDEXPI, a Python library for DEXPI files; the DEXPI project's example diagrams; a multimodal model such as Claude or Gemini to read tag numbers and notes.

  1. First step

    Collect 20 P&IDs whose licences allow reuse, for example from publicly funded pilot-plant reports, and label five by hand.

  2. Done looks like

    At least 100 real P&IDs from at least ten plants, each labelled as a graph of symbols and connections by two engineers and published or linked with its licence, and a reader that gets at least 95% of symbols and 90% of connections right on them under PID2Graph's scoring.