Three-dimensional morphable models (3DMMs) are powerful statistical tools for representing the 3D shapes and textures of an object class. Here we present the most complete 3DMM of the human head to date that includes face, cranium, ears, eyes, teeth and tongue. To achieve this, we propose two methods for combining existing 3DMMs of different overlapping head parts: (i). use a regressor to complete missing parts of one model using the other, and (ii). use the Gaussian Process framework to blend covariance matrices from multiple models. Thus, we build a new combined face-and-head shape model that blends the variability and facial detail of an existing face model (the LSFM) with the full head modelling capability of an existing head model (the LYHM). Then we construct and fuse a highly-detailed ear model to extend the variation of the ear shape. Eye and eye region models are incorporated into the head model, along with basic models of the teeth, tongue and inner mouth cavity. The new model achieves state-of-the-art performance. We use our model to reconstruct full head representations from single, unconstrained images allowing us to parameterize craniofacial shape and texture, along with the ear shape, eye gaze and eye color.

中文翻译：

---

建立完整的人体头部 3D 可变形模型


三维变形模型 (3DMM) 是用于表示对象类的 3D 形状和纹理的强大统计工具。在这里，我们展示了迄今为止最完整的人体头部 3DMM，包括面部、颅骨、耳朵、眼睛、牙齿和舌头。为了实现这一目标，我们提出了两种组合不同重叠头部的现有 3DMM 的方法：(i)。使用回归器使用另一个模型来完成一个模型的缺失部分，以及 (ii)。使用高斯过程框架混合来自多个模型的协方差矩阵。因此，我们构建了一个新的组合面部和头部形状模型，它将现有面部模型（LSFM）的可变性和面部细节与现有头部模型（LYHM）的完整头部建模功能相融合。然后我们构建并融合一个高度详细的耳朵模型，以扩展耳朵形状的变化。眼睛和眼部区域模型以及牙齿、舌头和口腔内部的基本模型都被纳入头部模型中。新型号实现了最先进的性能。我们使用我们的模型从单个无约束图像重建完整的头部表示，使我们能够参数化颅面形状和纹理，以及耳朵形状、眼睛注视和眼睛颜色。