Startups use AI to develop "digital twins" for dubbing actors to generate content with their own voice

CTOnews.com, Oct. 15, according to Bloomberg on the 14th, a voice actor Ciccy Jones founded AI startup Morpheme, which aims to use AI to "reshape" the dubbing and onomatopoeia of cartoons to games.

Tu Yuan Pexels, who has previously worked on a series of major dubbing works such as Starry Sky and Baird Gate, once needed to dub a scene in which an astronaut woke up in space with difficulty breathing. "after 10 minutes, she almost fainted," she said bluntly.

According to reports, if her project can be favored by technology investors, in the future these complex dubbing work will only need to be outsourced to their own "digital twins"-driven by AI, using the actor's own voice to generate specified voice.

In addition, the company is developing a "sound library" designed to simulate heavy breathing sounds and screams that customers can reuse during game development. The software can also render actors' voices into other languages, which is expected to enable companies to spread across cultures faster and at a lower cost.

While this kind of venture capital excites investors, it also makes creative people such as actors and writers "panic": in the game industry, people worry that AI may completely eliminate a certain type of job.

According to PitchBook, voice-related AI startups received $378.6 million (CTOnews.com Note: about 2.768 billion yuan currently) in 47 deals in 2022, some of which are using AI to clone and generate sound.