AIive: Interactive Visualization and Sonification of Neural Network in Virtual Reality

PubDate: Sep 2021

Teams: University of Toronto

Writers: Zhuoyue Lyu, Jiannan Li, Bryan Wang

PDF: AIive: Interactive Visualization and Sonification of Neural Network in Virtual Reality

Abstract

Artificial Intelligence (AI), especially Neural Network (NN), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present AIive, an interactive visualization of AI in Virtual Reality (VR) that brings AI “alive”. AIive enables users to manipulate the parameters of NN with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, AIive contributes an artistic and intuitive way to represent AI by integrating visualization, sonification, and direct manipulation in VR, potentially targeting a wide range of audiences.