Alibaba Dharma Institute Multimodal Dialogue Patent announcement: it can enrich the way of man-machine dialogue

CTOnews.com March 26 news, Alibaba Damoyuan (Hangzhou) Technology Co., Ltd. applied for "multimodal dialogue method, device, equipment and storage media" patent recently announced, which can enrich the way of man-machine dialogue.

A summary shows that the present disclosure relates to a multimodal dialogue method, a device, a device and a storage medium. By obtaining the multimodal information associated with the same problem, the invention carries out intention identification to the multimodal information, obtains the intention information, and carries out slot identification to the multimodal information to obtain one or more slot values.

Then, one or more reply messages corresponding to the multimodal information are generated according to the intention information and the one or more slot values. So that the user can describe the same problem and the target object of the problem through multiple modal information, so that the man-machine dialogue system can understand the same problem from multiple modes and generate one or more reply messages for the same problem. if it is multiple reply messages, the modes of multiple reply messages are different, thus the multi-modal dialogue is realized. It makes the dialogue mode between the user and the man-machine dialogue system flexible and diverse, and improves the user experience. The relevant map is attached to CTOnews.com:

According to previous reports, Ali Damo is developing a ChatGPT-like dialogue robot, which has been opened for testing by employees in the company. From the exposure screenshot, Alibaba may be a deep combination of AI large model technology and nail productivity tools. Ali responded that it is indeed in research and development and is currently in the internal testing stage.