Shulou(Shulou.com)11/24 Report--

CTOnews.com March 3 news, today is the National ear Day, vivo "sign language interpreter" function is now online. The App can transform the voice of hearing-impaired people into sign language and text in real time. It can also broadcast the sign language movements of hearing-impaired people with text and voice, and establish a new communication channel between hearing-impaired people and healthy people who do not understand sign language.

With the help of sign language interpreters, people with hearing impairment can not only communicate more smoothly with their family and friends, but also order food, shop and so on more conveniently. Speech to text, text to speech, text to sign language and sign language recognition to text are the core technologies to realize barrier-free communication. There are always many difficulties to be overcome in sign language recognition, such as how to accurately track finger joint movements and identify their directions and trajectories in a small space. how to deal with the unique grammatical order and ellipsis of sign language, the similarity and inclusion relationship between sign language actions and so on.

The OriginOS technology R & D team integrates AI to achieve the smooth translation of sign language to text and then to speech. At present, sign language interpreters have been able to recognize 1200 sign language words, with an accuracy of more than 80%, which is equivalent to CET-4, and can be applied to basic topic discussion scenarios. Sign language synthesis part, has covered more than 8000 of the words of the national general dictionary, can achieve smooth text-to-sign language translation.

In the future, the OriginOS technology R & D team will continue to dig deep into the technology and improve the products, plan to continuously upgrade the sign language recognition technology to cover CET-6, and the translation function will continue to optimize more usage scenarios.

CTOnews.com Note: March 3, 2023 is the 24th National ear Love Day with the theme of "Scientific ear Care and active Health".

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.