Experimental study to elicit effective multimodal behaviour in pedagogical agents

PubDate: November 2016

Teams: Beijing University of Posts and Telecommunications；Queen Mary University of London

Writers: Xiaojie Zha；Marie-Luce Bourguet

PDF: Experimental study to elicit effective multimodal behaviour in pedagogical agents

Abstract

This paper describes a small experimental study into the use of avatars to remediate the lecturer’s absence in voice-over-slide material. Four different avatar behaviours are tested. Avatar A performs all the upper-body gestures of the lecturer, which were recorded using a 3D depth sensor. Avatar B is animated using few random gestures in order to create a natural presence that is unrelated to the speech. Avatar C only performs the lecturer’s pointing gestures, as these are known to indicate important parts of a lecture. Finally, Avatar D performs “lecturer-like” gestures, but these are desynchronised with the speech. Preliminary results indicate students’ preference for Avatars A and C. Although the effect of avatar behaviour on learning did not prove statistically significant, students’ comments indicate that an avatar that behaves quietly and only performs some of the lecturer’s gestures (pointing) is effective. The paper also presents a simple empirical method for automatically detecting pointing gestures in Kinect recorded lecture data.