Nvidia has made Audio2Face available, an innovative AI tool that allows you to automatically generate realistic facial movements of 3D avatars based on voice data. The company announced this on its official website.
Developers can now use Audio2Face to create lifelike and natural characters in video games, 3D applications and virtual environments. The technology analyzes the nuances of the voice, such as intonation, tempo and emotional coloring, and then automatically synthesizes the appropriate animation for the character’s face. Animation can be used both in already recorded videos and in real time during online broadcasts or interactive presentations.
Several leading studios have already used Audio2Face in their projects. These include Farm51 for Chernobylite 2: Exclusion Zone and the developers of Alien: Rogue Incursion Evolved Edition, who integrated the technology to improve character animations and create a more immersive user experience.
Nvidia has also made available models and toolkits for developers, allowing the system to be integrated into various projects and adjusted to specific needs, expanding the possibilities of personalizing animations.
Recall that on September 24, Alibaba integrated Nvidia Robotics into its AI platform. This will give customers the opportunity to develop solutions in the field of Physical AI – from humanoid robots to autonomous vehicles.
