当前位置: X-MOL 学术IEEE Trans. Ind. Inform. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Toward Identity Preserving Face Synthesis Between Sketches and Photos Using Deep Feature Injection
IEEE Transactions on Industrial Informatics ( IF 12.3 ) Pub Date : 2021-04-22 , DOI: 10.1109/tii.2021.3074989
Ye Lin , Keren Fu , Shenggui Ling , Jiang Wang , Peng Cheng

Identity preservation is crucial for the practical application of face sketch and photo synthesis, such as law enforcement and entertainment. However, existing methods mainly focus on generating faces with good visual quality, leading the evaluation of identity preservation is partial and insufficient. Besides, it is difficult to simultaneously synthesize photos and sketches that have good visual quality and identity preservation. In this article, we propose to utilize auxiliary deep features extracted by an off-the-shelf face classifier to inject into the synthesis processes, so that the synthesized faces have more identity information. Furthermore, we propose a light interpolated convolutional neural network that has a shared encoder and two face-specialized decoders to simultaneously complete the transformations between sketches and photos. Evaluations on identity preservation and visual quality show our method is superior to existing methods in synthesizing both sketches and photos, and is qualified in practical application.

中文翻译:

使用深度特征注入实现草图和照片之间的身份保持人脸合成

身份保存对于面部素描和照片合成的实际应用至关重要,例如执法和娱乐。然而,现有方法主要侧重于生成具有良好视觉质量的人脸,导致对身份保留的评估是局部和不足的。此外,很难同时合成具有良好视觉质量和身份保留的照片和草图。在本文中,我们建议利用现成的人脸分类器提取的辅助深度特征注入合成过程,使合成的人脸具有更多的身份信息。此外,我们提出了一种光插值卷积神经网络,该网络具有共享编码器和两个面部专用解码器,可同时完成草图和照片之间的转换。
更新日期:2021-04-22
down
wechat
bug