MARS combines video game engines, camera-tracking technology, mixed reality workflows and LED screens to create its performance stage and studio.
British art historian and BBC presenter Dr James Fox worked with the creative team at The Experience Machine and the technical and production teams at Bild Studios to produce Masterpiece, a 3D representation of Edward Hopper’s Nighthawks painting.
The scene was created as extracted 3D geometry with detailed layers of texturing added; partly handmade, partly AI-generated, that would resemble the brush strokes of the painting style.
Finally, the 3D scene was imported into the game engine Unreal Engine and rendered in real-time based on the position of the physical film camera on the MARS stage.