A Virtual Reality Assembly Assessment Benchmark for Measuring VR Performance & Limitations

PubDate: March 2019

Teams: Daimler Research & Development；University of Breme；Ulm University

Writers: Michael Otto；Eva Lampen；Philipp Agethen； Mareike Langohr；Gabriel Zachmann；Enrico Rukzio

PDF: A Virtual Reality Assembly Assessment Benchmark for Measuring VR Performance & Limitations

Abstract

With an increasing product complexity in manufacturing industry, virtual reality (VR) offers the possibility to immersively assess assembly processes already in early product development stages. Within production validation phases, engineers visually assess product part assembly and interactively validate corresponding production processes. Nevertheless, by now research does not give answers on how VR assembly system’s performance can be measured with respect to its technical limitations. The proposed Virtual Reality Assembly Assessment (VR2A) benchmark is an open, standardized experiment design for evaluating the overall VR assembly assessment performance in terms of sizes and clearances instead of measuring single technical impact factors within the interaction cycle, such as tracking, rendering and visualization limitations. VR2A benchmark focusses on the overall production engineer’s assessment objective generating quantifiable metrics. Using VR2A, users gain practical insights on their overall VR assessment system’s performance and limitations. An in-depth evaluation with production engineers (N=32) revealed, that negative clearances can be detected more easily than positive ones, part sizes directly correlate with the assessment performance. Additionally, the evaluation showed that VR2A is easy to use, universally usable and generates objective insights on the applied VR system.