Learning 6D Object Pose Estimation Using 3D Object Coordinates

Title: Learning 6D Object Pose Estimation Using 3D Object Coordinates

Teams: Microsoft

Writers: Eric Brachmann Alexander Krull Frank Michel Stefan Gumhold Jamie Shotton Carsten Rother

Publication date: September 2014

Abstract

This work addresses the problem of estimating the 6D pose of specific objects from a single RGB-D image. We present a flexible approach that can deal with generic objects, both textured and texture-less. The key new concept is a learned, intermediate representation in form of a dense 3D object coordinate labelling paired with a dense class labelling. We are able to show that for a common dataset with texture-less objects, where template-based techniques are suitable and state of the art, our approach is slightly superior in terms of accuracy. We also demonstrate the benefits of our approach, compared to template-based techniques, in terms of robustness with respect to varying lighting conditions. Towards this end, we contribute a new ground truth dataset with 10k images of 20 objects captured each under three different lighting conditions. We demonstrate that our approach scales well with the number of objects and has capabilities to run fast.