当前位置:
X-MOL 学术
›
arXiv.cs.MM
›
论文详情
Our official English website, www.x-mol.net, welcomes your
feedback! (Note: you will need to create a separate account there.)
User-assisted Video Reflection Removal
arXiv - CS - Multimedia Pub Date : 2020-09-07 , DOI: arxiv-2009.03281 Amgad Ahmed, Suhong Kim, Mohamed Elgharib, Mohamed Hefeeda
arXiv - CS - Multimedia Pub Date : 2020-09-07 , DOI: arxiv-2009.03281 Amgad Ahmed, Suhong Kim, Mohamed Elgharib, Mohamed Hefeeda
Reflections in videos are obstructions that often occur when videos are taken
behind reflective surfaces like glass. These reflections reduce the quality of
such videos, lead to information loss and degrade the accuracy of many computer
vision algorithms. A video containing reflections is a combination of
background and reflection layers. Thus, reflection removal is equivalent to
decomposing the video into two layers. This, however, is a challenging and
ill-posed problem as there is an infinite number of valid decompositions. To
address this problem, we propose a user-assisted method for video reflection
removal. We rely on both spatial and temporal information and utilize sparse
user hints to help improve separation. The key idea of the proposed method is
to use motion cues to separate the background layer from the reflection layer
with minimal user assistance. We show that user-assistance significantly
improves the layer separation results. We implement and evaluate the proposed
method through quantitative and qualitative results on real and synthetic
videos. Our experiments show that the proposed method successfully removes
reflection from video sequences, does not introduce visual distortions, and
significantly outperforms the state-of-the-art reflection removal methods in
the literature.
中文翻译:
用户辅助的视频反射去除
视频中的反射是在玻璃等反射面后面拍摄视频时经常出现的障碍物。这些反射会降低此类视频的质量,导致信息丢失并降低许多计算机视觉算法的准确性。包含反射的视频是背景和反射层的组合。因此,反射去除相当于将视频分解为两层。然而,这是一个具有挑战性和不适定的问题,因为存在无限数量的有效分解。为了解决这个问题,我们提出了一种用户辅助的视频反射去除方法。我们依赖空间和时间信息,并利用稀疏的用户提示来帮助改进分离。所提出方法的关键思想是使用运动线索在最少的用户帮助下将背景层与反射层分开。我们表明用户辅助显着改善了层分离结果。我们通过真实和合成视频的定量和定性结果来实施和评估所提出的方法。我们的实验表明,所提出的方法成功地去除了视频序列的反射,不会引入视觉失真,并且明显优于文献中最先进的反射去除方法。
更新日期:2020-09-08
中文翻译:
用户辅助的视频反射去除
视频中的反射是在玻璃等反射面后面拍摄视频时经常出现的障碍物。这些反射会降低此类视频的质量,导致信息丢失并降低许多计算机视觉算法的准确性。包含反射的视频是背景和反射层的组合。因此,反射去除相当于将视频分解为两层。然而,这是一个具有挑战性和不适定的问题,因为存在无限数量的有效分解。为了解决这个问题,我们提出了一种用户辅助的视频反射去除方法。我们依赖空间和时间信息,并利用稀疏的用户提示来帮助改进分离。所提出方法的关键思想是使用运动线索在最少的用户帮助下将背景层与反射层分开。我们表明用户辅助显着改善了层分离结果。我们通过真实和合成视频的定量和定性结果来实施和评估所提出的方法。我们的实验表明,所提出的方法成功地去除了视频序列的反射,不会引入视觉失真,并且明显优于文献中最先进的反射去除方法。