Huang Renxun sang "Jingle Bells" with AI "Toy Jensen"

CTOnews.com, December 22 / PRNewswire-FirstCall-Asianet /-- in response to breaking into the studio of two online singers, NVIDIA used AI to create "Toy Jensen" and sing "Jingle Bells".

Huang Renxun said that although he was not good at singing, he used NVIDIA's voice AI, computer vision, natural language understanding, recommendation engine and simulation technology to create a Toy Jenson avatar, which he used to sing the familiar Christmas song "Jingle Bells" to respond to the two singers.

NVIDIA's creative team imported the cloud native AI microservice and workflow of the NVIDIA Omniverse Avatar Cloud Engine (ACE) platform, used the recently developed voice conversion model to extract the voice of a professional singer from the sample, converted it into Toy Jensen voice, and then used technologies such as Audio2Face and Audio2Gesture to generate realistic facial expressions and body movements for the entire performance.