Virtual Conversation with Real-Time Prediction of Body Moments/Gestures on Video Streaming Data

PubDate: March 2020

Teams: Wipro Technology Limited

Writers: Gopichand AgnihotramRajesh KumarPandurang NaikRahul YadavEmail author

PDF: Virtual Conversation with Real-Time Prediction of Body Moments/Gestures on Video Streaming Data

Abstract

The exisitng conversation system where the user interacts with the virtual system with voice and virtual system replies to the user based on what user speaks. In this context whenever user makes some gestures to communicate with the virtual system, the virtual system will miss out those communications. For example, user instead of speaking, may nod head for “yes” or “no” and user can also use hand signals to respond to the virtual system. If these events are not addressed then the conversation is not very interactive and natural human-like interaction will start losing important information. The paper describes how the user body moments/gestures will help effective conversation with the virtual system and virtual conversation system can understand the user misspelled conversation, missed conversation effectively with user gesture/body movements.