Skip to main content
SpringerLink
Log in

PSNet: change detection with prototype similarity

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Change detection is a fundamental problem in remote sensing image processing. Due to the great advantages in learning the knowledge representations and the complex relationship from large-scale datasets, deep learning has made great progress in change detection tasks in remote sensing community. However, most of the existing methods based on deep learning for change detection are implemented by learning differences of image pairs directly without paying considerations in influences of unstructured and temporal changes, or called nature changes, such as light and seasonal changes. In this paper, an end-to-end deep learning network for remote sensing image change detection is proposed, aiming to accurately detect the change of regions from a high-resolution image pair by learning prototype similarity, in which the metric learning is used and it is one of the meta-learning methods to learn change prototypes from support image pairs. The similarity between the query image pairs and the change prototypes can be measured by a learnable CNN metric. The experimental results based on the two public change detection datasets of high-resolution satellite images, CDD and BCDD, show that our proposed method performs better than other state-of-the-art change detection methods with an improvement of 3.5% and 0.4%, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Alcantarilla, P.F., Stent, S., Ros, G., Arroyo, R., Gherardi, R.: Street-view change detection with deconvolutional networks. Auton. Robot. 42(7), 1301–1322 (2018)

    Article  Google Scholar 

  2. Arabi, M.E.A., Karoui, M.S., Djerriri, K.: Optical remote sensing change detection through deep siamese network. In: IEEE International Geoscience and Remote Sensing Symposium, pp. 5041–5044 (2018)

  3. Celik, T.: Unsupervised change detection in satellite images using principal component analysis and \(k\)-means clustering. IEEE Geosci. Remote Sens. Lett. 6(4), 772–776 (2009)

    Article  MathSciNet  Google Scholar 

  4. Chen, J., Yuan, Z., Peng, J., Chen, L., Huang, H., Zhu, J., Lin, T., Li, H.: Dasnet: Dual attentive fully convolutional siamese networks for change detection of high resolution satellite images. arXiv Computer Vision and Pattern Recognition (2020)

  5. Chen, L., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFS. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2018)

    Article  Google Scholar 

  6. Daudt, R.C., Saux, B.L., Boulch, A.: Fully convolutional siamese networks for change detection. In: IEEE International Conference on Image Processing, pp. 4063–4067 (2018)

  7. Dong, N., Xing, E.P.: Few-shot semantic segmentation with prototype learning. In: British Machine Vision Conference, p. 79 (2018)

  8. Gilyepes, J.L., Ruiz, L.A., Recio, J.A., Balaguerbeser, A., Hermosilla, T.: Description and validation of a new set of object-based temporal geostatistical features for land-use/land-cover change detection. ISPRS J. Photogram. Remote Sens. 121, 77–91 (2016)

    Article  Google Scholar 

  9. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition pp. 770–778 (2016)

  10. Huang, C., Song, K., Kim, S., Townshend, J.R.G., Davis, P., Masek, J.G., Goward, S.N.: Use of a dark object concept and support vector machines to automate forest cover change analysis. Remote Sens. Environ. 112(3), 970–985 (2008)

    Article  Google Scholar 

  11. Hussain, M., Chen, D., Cheng, A., Wei, H., Stanley, D.: Change detection from remotely sensed images: from pixel-based to object-based approaches. ISPRS J. Photogram. Remote Sens. 80, 91–106 (2013)

    Article  Google Scholar 

  12. Ji, S., Shen, Y., Lu, M., Zhang, Y.: Building instance change detection from large-scale aerial images using convolutional neural networks and simulated samples. Remote Sens. 11(11), 1343 (2019)

    Article  Google Scholar 

  13. Ji, S., Wei, S., Lu, M.: Fully convolutional networks for multisource building extraction from an open aerial and satellite imagery data set. IEEE Trans. Geosci. Remote Sens. 57(1), 574–586 (2019)

    Article  Google Scholar 

  14. Lebedev, M.A., Vizilter, Y., Vygolov, O.V., Knyaz, V.A., Rubis, A.Y.: Change detection in remote sensing images using conditional adversarial networks. ISPRS-International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, pp. 565–571 (2018)

  15. Lin, T., Goyal, P., Girshick, R., He, K., Dollar, P.: Focal loss for dense object detection. In: IEEE International Conference on Computer Vision, pp. 2999–3007 (2017)

  16. Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)

  17. Lv, P., Zhong, Y., Zhao, J., Zhang, L.: Unsupervised change detection based on hybrid conditional random field model for high spatial resolution remote sensing imagery. IEEE Trans. Geosci. Remote Sens. 56(7), 4002–4015 (2018)

    Article  Google Scholar 

  18. Ma, L., Li, M., Blaschke, T., Ma, X., Tiede, D., Cheng, L., Chen, Z., Chen, D.: Object-based change detection in urban areas: the effects of segmentation strategy, scale, and feature space on unsupervised methods. Remote Sens. 8(9), 761 (2016)

    Article  Google Scholar 

  19. Ma, W., Xiong, Y., Wu, Y., Yang, H., Zhang, X., Jiao, L.: Change detection in remote sensing images based on image mapping and a deep capsule network. Remote Sens. 11(6), 626 (2019)

    Article  Google Scholar 

  20. Papadomanolaki, M., Verma, S., Vakalopoulou, M., Gupta, S., Karantzalos, K.: Detecting urban changes with recurrent neural networks from multitemporal sentinel-2 data. In: IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium, pp. 214–217 (2019)

  21. Peng, D., Zhang, M., Wanbing, G.: End-to-end change detection for high resolution satellite images using improved UNet++. Remote Sens. 11(06), 1382 (2019). https://doi.org/10.3390/rs11111382

    Article  Google Scholar 

  22. Rakelly, K., Shelhamer, E., Darrell, T., Efros, A., Levine, S.: Conditional networks for few-shot semantic segmentation. In: International Conference on Learning Representations (2018)

  23. Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, pp. 234–241 (2015)

  24. Saha, S., Bovolo, F., Bruzzone, L.: Unsupervised deep change vector analysis for multiple-change detection in VHR images. IEEE Trans. Geosci. Remote Sens. 57(6), 3677–3693 (2019)

    Article  Google Scholar 

  25. Snell, J., Swersky, K., Zemel, R.S.: Prototypical networks for few-shot learning. In: Advances in Neural Information Processing Systems, pp. 4077–4087 (2017)

  26. Song, H.O., Xiang, Y., Jegelka, S., Savarese, S.: Deep metric learning via lifted structured feature embedding. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 4004–4012 (2016)

  27. Volpi, M., Tuia, D., Bovolo, F., Kanevski, M., Bruzzone, L.: Supervised change detection in VHR images using contextual information and support vector machines. Int. J. Appl. Earth Observ. Geoinf. 20, 77–85 (2013)

    Article  Google Scholar 

  28. Wang, K., Liew, J.H., Zou, Y., Zhou, D., Feng, J.: Panet: Few-shot image semantic segmentation with prototype alignment. In: IEEE International Conference on Computer Vision, pp. 9197–9206 (2019)

  29. Wu, C., Du, B., Cui, X., Zhang, L.: A post-classification change detection method based on iterative slow feature analysis and Bayesian soft fusion. Remote Sens. Environ. 199, 241–255 (2017)

    Article  Google Scholar 

  30. Yosinski, J., Clune, J., Nguyen, A., Fuchs, T.J., Lipson, H.: Understanding neural networks through deep visualization. arXiv: Computer Vision and Pattern Recognition (2015)

  31. Zhang, C., Lin, G., Liu, F., Yao, R., Shen, C.: Canet: Class-agnostic segmentation networks with iterative refinement and attentive few-shot learning. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5217–5226 (2019)

  32. Zhang, M., Xu, G., Chen, K., Yan, M., Sun, X.: Triplet-based semantic relation learning for aerial remote sensing image change detection. IEEE Geosci. Remote Sens. Lett. 16(2), 266–270 (2019)

    Article  Google Scholar 

  33. Zhang, Y., Peng, D., Huang, X.: Object-based change detection for VHR images based on multiscale uncertainty analysis. IEEE Geosci. Remote Sens. Lett. 15(1), 13–17 (2018)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by National Science Fund of China: No. 61871170; Key Research and Development Plan of Zhejiang: No. 2021C03131; The Basic Research Program of KY2017210A001; Key Laboratory of Brain Machine Collaborative Intelligence of Zhejiang Province.

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, 310018, Zhejiang, China

    Peiqi Tang, Jianjun Li, Feifei Ding & Weikun Chen

  2. The 36th Institute of China Electronics Technology Group, Jiaxing, 100048, Zhejiang, China

    Xinfu Li

Authors
  1. Peiqi Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jianjun Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Feifei Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Weikun Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xinfu Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jianjun Li.

Ethics declarations

Conflict of interest

We declare that we have no conflict of interest with other people or organizations.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tang, P., Li, J., Ding, F. et al. PSNet: change detection with prototype similarity. Vis Comput 38, 3541–3550 (2022). https://doi.org/10.1007/s00371-021-02177-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-021-02177-4

Keywords

Search

Navigation