... MARZ, which stands for Monsters Aliens Robots Zombies, isn’t interested in being a onetime solution in Hollywood. The company has used its proprietary AI technology on 27 projects so far, including Stranger Things, Jack Ryan, Being the Ricardos, Umbrella Academy, and No Way Home, where it focused its energies on Willem Dafoe. So far MARZ’s AI de-aging technology, called Vanity AI, has been offered as a service, but later this year the company plans to allow businesses and creatives to download the Vanity software for free and pay MARZ a fee based on the number of shots that are processed. ...
Vanity works by first “learning” the face of an actor or actress. “You literally upload five images of an actor; you tag it. Those five images teach the system who the actor is,” Panousis says.
“Once you’ve created that mask, Vanity is going to comb through every shot in your movie and find the actor and is actually going to stick the mask on the face automatically,” Panousis says. “So if you’re an artist going in to work on a shot, all you’re actually doing now is confirming that the mask is (fitted) correctly. ...
How do you dub film and TV projects in a more seamless and effective way than simply laying on new audio? The company’s solution, which is still in development, is called LipDub, and uses AI to re-create the bottom portion of an actor’s face so that it synchs with the dubbed language. ...
See the full story here: https://www.fastcompany.com/90860276/monsters-aliens-robots-zombies-marz-hollywood-vfx-ai