Live Emoji: A Live Storytelling VR System with Programmable Cartoon-Style Emotion Embodiment
PubDate: December 2019
Teams: Hong Kong University of Science and Technology
Writers: Zhenjie Zhao; Feng Han; Xiaojuan Ma
We introduce a novel cartoon-style hybrid emotion embodiment model for live storytelling in virtual reality (VR). It contains an avatar with six basic emotions and an auxiliary multimodal display to enhance the expression of emotions. We further design and implement a system to teleoperate the embodiment model in VR for live storytelling. Specifically, 1) we design a novel visual programming tool that allows users to customize emotional effects based on the emotion embodiment model; 2) we design a novel face tracking module to map presenters’ emotional states to the avatar in VR. Our web-based implementation makes the application easy to use. This is an accompanying paper extracted from  for the demo session in IEEE AIVR 2019.