NVIDIA ACE Enables Easier Interactive Avatars
... To deploy interactive avatars such as Violet, developers need to produce the 3D character can use computer vision, natural language understanding, AI and advanced avatar visualization tools. This has been extremely difficult up until now. While Epic Games provided a powerful tool for MetaHumans to create the avatar itself, most applications of the MetaHumans typically had them being driven by a person, akin to a puppet. The ACE platform provides artists and TD with a way to build digital humans driven by a core AI engine. This allows the avatars to effectively be independent and ‘come alive’. ...
How Omniverse ACE Brings Violet to Life
The demo shows Violet as a fully rigged avatar with basic animation. To create Violet, NVIDIA’s team used the company’s Unified Compute Framework (UCF), a fully accelerated framework that enables developers to combine accelerated microservices into real-time AI applications. UCF helped the team build a graph of microservices for Violet that were deployed in the cloud. ...
Omniverse ACE powers the backend of interactive avatars, essentially acting as Violet’s brain. Additionally, two reference applications are built on ACE: NVIDIA Tokkio and NVIDIA Maxine. NVIDIA Tokkio leverages ACE, to make it easier to build and customize lifelike virtual assistants and digital humans. ...
Omniverse ACE also delivers microservices that enable developers to access the NVIDIA AI technology, with no coding required. Some of the latest microservices include:
- Animation AI: Omniverse Audio2Face simplifies the animation of a 3D character to match any voice-over track, helping users animate characters for games, films or real-time digital assistants.
- Conversational AI: Includes the NVIDIA Riva SDK for speech AI and NVIDIA NeMo Megatron framework for natural language processing, allowing developers to quickly build and deploy cutting-edge applications that deliver high-accuracy, expressive voices and respond in real-time. ...
See the full story here: https://www.fxguide.com/quicktakes/nvidia-ace-enables-easier-interactive-avatars/?fbclid=IwAR1Z3iZ0ATcq_GNKRCgjv8XE-25qI-O1TN3_AsI6uAI1n7zLm-vPEemdps0
