当前位置: X-MOL 学术IEEE Trans. Cybern. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
SG-One: Similarity Guidance Network for One-Shot Semantic Segmentation.
IEEE Transactions on Cybernetics ( IF 11.8 ) Pub Date : 2020-06-04 , DOI: 10.1109/tcyb.2020.2992433
Xiaolin Zhang , Yunchao Wei , Yi Yang , Thomas S. Huang

One-shot image semantic segmentation poses a challenging task of recognizing the object regions from unseen categories with only one annotated example as supervision. In this article, we propose a simple yet effective similarity guidance network to tackle the one-shot (SG-One) segmentation problem. We aim at predicting the segmentation mask of a query image with the reference to one densely labeled support image of the same category. To obtain the robust representative feature of the support image, we first adopt a masked average pooling strategy for producing the guidance features by only taking the pixels belonging to the support image into account. We then leverage the cosine similarity to build the relationship between the guidance features and features of pixels from the query image. In this way, the possibilities embedded in the produced similarity maps can be adopted to guide the process of segmenting objects. Furthermore, our SG-One is a unified framework that can efficiently process both support and query images within one network and be learned in an end-to-end manner. We conduct extensive experiments on Pascal VOC 2012. In particular, our SG-One achieves the mIoU score of 46.3%, surpassing the baseline methods.

中文翻译:

SG-One:用于一键语义分割的相似性指导网络。

单幅图像语义分割带来了一项艰巨的任务,即仅以一个带注释的示例作为监督,从看不见的类别中识别对象区域。在本文中,我们提出了一个简单而有效的相似性指导网络来解决单发(SG-One)分割问题。我们旨在参考同一类别的一个密集标记的支持图像来预测查询图像的分割蒙版。为了获得支持图像的鲁棒代表性特征,我们首先采用屏蔽平均池化策略,通过仅考虑属于支持图像的像素来生成指导特征。然后,我们利用余弦相似度来建立引导特征和查询图像中像素特征之间的关系。通过这种方式,嵌入在生成的相似图中的可能性可以用来指导对象的分割过程。此外,我们的SG-One是一个统一的框架,可以有效地处理一个网络内的支持和查询图像,并且可以以端到端的方式进行学习。我们在Pascal VOC 2012上进行了广泛的实验。特别是,我们的SG-One达到了46.3%的mIoU分数,超过了基线方法。
更新日期:2020-06-04
down
wechat
bug