当前位置: X-MOL 学术IEEE Trans. Image Process. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Unsupervised Online Video Object Segmentation With Motion Property Understanding.
IEEE Transactions on Image Processing ( IF 10.8 ) Pub Date : 2019-07-26 , DOI: 10.1109/tip.2019.2930152
Tao Zhuo , Zhiyong Cheng , Peng Zhang , Yongkang Wong , Mohan Kankanhalli

Unsupervised video object segmentation aims to automatically segment moving objects over an unconstrained video without any user annotation. So far, only few unsupervised online methods have been reported in the literature, and their performance is still far from satisfactory because the complementary information from future frames cannot be processed under online setting. To solve this challenging problem, in this paper, we propose a novel unsupervised online video object segmentation (UOVOS) framework by construing the motion property to mean moving in concurrence with a generic object for segmented regions. By incorporating the salient motion detection and the object proposal, a pixel-wise fusion strategy is developed to effectively remove detection noises, such as dynamic background and stationary objects. Furthermore, by leveraging the obtained segmentation from immediately preceding frames, a forward propagation algorithm is employed to deal with unreliable motion detection and object proposals. Experimental results on several benchmark datasets demonstrate the efficacy of the proposed method. Compared to state-of-the-art unsupervised online segmentation algorithms, the proposed method achieves an absolute gain of 6.2%. Moreover, our method achieves better performance than the best unsupervised offline algorithm on the DAVIS-2016 benchmark dataset. Our code is available on the project website: https://www.github.com/visiontao/uovos.

中文翻译:

具有运动属性理解的无监督在线视频对象分割。

无监督视频对象分割旨在自动在不受约束的视频上分割运动对象,而无需任何用户注释。迄今为止,文献中仅报道了很少的无监督在线方法,但是由于无法在在线环境下处理来自未来框架的补充信息,因此其性能仍不能令人满意。为了解决这个具有挑战性的问题,本文提出了一种新颖的无监督在线视频对象分割(UOVOS)框架,该框架将运动属性解释为与分割区域的通用对象并发地运动。通过结合显着运动检测和对象提议,开发了逐像素融合策略以有效去除检测噪声,例如动态背景和静止对象。此外,通过利用从紧前的帧中获得的分段,采用前向传播算法来处理不可靠的运动检测和对象建议。在几个基准数据集上的实验结果证明了该方法的有效性。与最新的无监督在线分割算法相比,该方法的绝对增益为6.2%。此外,与DAVIS-2016基准数据集上的最佳无监督离线算法相比,我们的方法具有更好的性能。我们的代码可在项目网站上找到:https://www.github.com/visiontao/uovos。在几个基准数据集上的实验结果证明了该方法的有效性。与最新的无监督在线分割算法相比,该方法的绝对增益为6.2%。此外,与DAVIS-2016基准数据集上的最佳无监督离线算法相比,我们的方法具有更好的性能。我们的代码可在项目网站上找到:https://www.github.com/visiontao/uovos。在几个基准数据集上的实验结果证明了该方法的有效性。与最新的无监督在线分割算法相比,该方法的绝对增益为6.2%。此外,与DAVIS-2016基准数据集上的最佳无监督离线算法相比,我们的方法具有更好的性能。我们的代码可在项目网站上找到:https://www.github.com/visiontao/uovos。
更新日期:2020-04-22
down
wechat
bug