In this paper, we propose a novel image-to-image GAN framework for eyeglasses removal, called ByeGlassesGAN, which is used to automatically detect the position of eyeglasses and then remove them from face images. Our ByeGlassesGAN consists of an encoder, a face decoder, and a segmentation decoder. The encoder is responsible for extracting information from the source face image, and the face decoder utilizes this information to generate glasses-removed images. The segmentation decoder is included to predict the segmentation mask of eyeglasses and completed face region. The feature vectors generated by the segmentation decoder are shared with the face decoder, which facilitates better reconstruction results. Our experiments show that ByeGlassesGAN can provide visually appealing results in the eyeglasses-removed face images even for semi-transparent color eyeglasses or glasses with glare. Furthermore, we demonstrate significant improvement in face recognition accuracy for face images with glasses by applying our method as a pre-processing step in our face recognition experiment.

中文翻译：

---

ByeGlassesGAN：面部图像的身份保留眼镜去除

在本文中，我们提出了一种新颖的用于眼镜去除的图像到图像 GAN 框架，称为 ByeGlassesGAN，用于自动检测眼镜的位置，然后将其从面部图像中去除。我们的 ByeGlassesGAN 由一个编码器、一个人脸解码器和一个分割解码器组成。编码器负责从源人脸图像中提取信息，人脸解码器利用这些信息生成去除眼镜的图像。包含分割解码器以预测眼镜的分割掩码和完整的面部区域。分割解码器生成的特征向量与人脸解码器共享，有利于更好的重建结果。我们的实验表明，即使对于半透明彩色眼镜或有眩光的眼镜，ByeGlassesGAN 也可以在去除眼镜的面部图像中提供视觉上吸引人的结果。此外，通过将我们的方法作为我们人脸识别实验中的预处理步骤，我们证明了戴眼镜人脸图像的人脸识别准确度的显着提高。