Semantic 3d reconstruction of heads

Title: Semantic 3d reconstruction of heads

Teams: Microsoft

Writers: F Maninchedda C Häne B Jacquet A Delaunoy Marc Pollefeys

Publication date: September 2016

Abstract

We present a novel approach that jointly reconstructs the geometry of a human head and semantically segments it into labels such as skin, hair and eyebrows. In order to get faithful reconstructions from data captured in uncontrolled environments, we propose to adapt a recently introduced implicit volumetric surface normal based shape prior formulation. Shape prior based approaches critically rely on an accurate alignment between the data and the prior to succeed. To this end, we propose an automatic alignment procedure for the used shape prior formulation. We evaluate our alignment procedure thoroughly and show head reconstruction results on challenging datasets.