当前位置: X-MOL 学术arXiv.cs.GR › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Exemplar-Based 3D Portrait Stylization
arXiv - CS - Graphics Pub Date : 2021-04-29 , DOI: arxiv-2104.14559
Fangzhou Han, Shuquan Ye, Mingming He, Menglei Chai, Jing Liao

Exemplar-based portrait stylization is widely attractive and highly desired. Despite recent successes, it remains challenging, especially when considering both texture and geometric styles. In this paper, we present the first framework for one-shot 3D portrait style transfer, which can generate 3D face models with both the geometry exaggerated and the texture stylized while preserving the identity from the original content. It requires only one arbitrary style image instead of a large set of training examples for a particular style, provides geometry and texture outputs that are fully parameterized and disentangled, and enables further graphics applications with the 3D representations. The framework consists of two stages. In the first geometric style transfer stage, we use facial landmark translation to capture the coarse geometry style and guide the deformation of the dense 3D face geometry. In the second texture style transfer stage, we focus on performing style transfer on the canonical texture by adopting a differentiable renderer to optimize the texture in a multi-view framework. Experiments show that our method achieves robustly good results on different artistic styles and outperforms existing methods. We also demonstrate the advantages of our method via various 2D and 3D graphics applications. Project page is https://halfjoe.github.io/projs/3DPS/index.html.

中文翻译:

基于示例的3D肖像风格化

基于示例的肖像风格非常吸引人,并且非常需要。尽管取得了最近的成功,但它仍然具有挑战性,尤其是在同时考虑纹理和几何样式时。在本文中,我们提出了用于单次3D肖像风格转换的第一个框架,该框架可以生成几何形状被夸大和纹理风格化的3D人脸模型,同时保留原始内容的身份。它只需要一个任意样式的图像,而不是针对特定样式的大量训练示例,就可以提供经过完全参数化和解缠结的几何和纹理输出,并可以使用3D表示形式进行进一步的图形应用。该框架包括两个阶段。在第一个几何样式转换阶段,我们使用面部地标平移捕获粗略的几何样式并引导密集的3D面部几何形状的变形。在第二个纹理样式转移阶段,我们专注于通过采用可微分渲染器在多视图框架中优化纹理来对规范纹理执行样式转移。实验表明,我们的方法在不同的艺术风格上均取得了良好的效果,并且优于现有方法。我们还通过各种2D和3D图形应用程序展示了我们方法的优势。项目页面为https://halfjoe.github.io/projs/3DPS/index.html。实验表明,我们的方法在不同的艺术风格上均取得了良好的效果,并且优于现有方法。我们还通过各种2D和3D图形应用程序展示了我们方法的优势。项目页面为https://halfjoe.github.io/projs/3DPS/index.html。实验表明,我们的方法在不同的艺术风格上均取得了良好的效果,并且优于现有方法。我们还通过各种2D和3D图形应用程序展示了我们方法的优势。项目页面为https://halfjoe.github.io/projs/3DPS/index.html。
更新日期:2021-04-30
down
wechat
bug