1. Video generation: Generative video tools, such as Runway’s Gen-2and Pika, that use video diffusion models are capable of synthesizing novel video, creating short, soundless animations from text prompts, images or video.
2. Neural radiance fields (NeRFs): .... To create a NeRF, a neural network is trained on a simple recorded video from any camera or just a partial set of 2D images, meaning they don’t need to show all perspectives, sides or angles of the object or scene. The network is then able to generate a high-fidelity 3D representation of an object or scene by inferring unseen viewpoints, even those not captured in training data provided to the model. ...
3. Video avatars: Generative AI tools developed by Synthesia, Soul Machines and HeyGen can create entirely synthetic, photorealistic avatars that combine deepfake video and synthetic speech to precisely replicate a specific person’s appearance, voice, expressions and mannerisms. These unique personal AI avatars have been variously referred to as digital humans, twins, doubles or clones. ...
See the full story here: https://variety.com/vip/how-generative-ai-could-enable-a-new-era-filmmaking-1235898355/