Recently, technologies such as face detection, facial landmark localisation and face recognition and verification have matured enough to provide effective and efficient solutions for imagery captured under arbitrary conditions (referred to as “in-the-wild”). This is partially attributed to the fact that comprehensive “in-the-wild” benchmarks have been developed for face detection, landmark localisation and recognition/verification. A very important technology that has not been thoroughly evaluated yet is deformable face tracking “in-the-wild”. Until now, the performance has mainly been assessed qualitatively by visually assessing the result of a deformable face tracking technology on short videos. In this paper, we perform the first, to the best of our knowledge, thorough evaluation of state-of-the-art deformable face tracking pipelines using the recently introduced 300 VW benchmark. We evaluate many different architectures focusing mainly on the task of on-line deformable face tracking. In particular, we compare the following general strategies: (a) generic face detection plus generic facial landmark localisation, (b) generic model free tracking plus generic facial landmark localisation, as well as (c) hybrid approaches using state-of-the-art face detection, model free tracking and facial landmark localisation technologies. Our evaluation reveals future avenues for further research on the topic.

中文翻译：

---

变形人脸追踪“野外”综合性能评估

近年来，人脸检测、人脸标志定位以及人脸识别和验证等技术已经足够成熟，可以为任意条件下（称为“野外”）捕获的图像提供有效且高效的解决方案。这部分归因于这样一个事实：已经为人脸检测、地标定位和识别/验证开发了全面的“野外”基准。一项尚未得到彻底评估的非常重要的技术是“野外”可变形面部跟踪。到目前为止，主要通过目视评估可变形人脸跟踪技术在短视频上的结果来定性评估其性能。在本文中，我们使用最近推出的 300 VW 基准对最先进的可变形面部跟踪管道进行了首次全面评估。我们评估了许多不同的架构，主要关注在线可变形面部跟踪的任务。特别是，我们比较以下一般策略：（a）通用面部检测加通用面部标志定位，（b）通用无模型跟踪加通用面部标志定位，以及（c）使用最新技术的混合方法艺术人脸检测、无模型跟踪和面部标志定位技术。我们的评估揭示了该主题进一步研究的未来途径。