Skip to main content
Log in

Incomplete multi-view subspace clustering with adaptive instance-sample mapping and deep feature fusion

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Multi-view subspace clustering has been widely applied in practical applications. It fuses complementary information across multiple views and treats all samples of a view as a set of bases of a generalized subspace. Meanwhile, it assumes that an instance has all features corresponding to all views. However, each view may lose some features due to the malfunction, which results in an incomplete multi-view dataset. This paper presents an incomplete multi-view subspace clustering with adaptive instance-sample mapping and deep feature fusion algorithm (IMDF). Owing to the good performance of attention mechanism, we fuse deep features adaptively extracted by convolutional neural networks in a weighted way to integrate abundant information from distinctive views, reduce redundancy between features, and generalize a robust and compact representation before self-representation stage. We jointly process feature training and clustering for a specific task to weaken the sensitivity of model to pre-extracted features. At the same time, we propose a modified weighted view-specific instance-sample mapping strategy to solve the inconsistent dimensions problem induced by different numbers of samples of distinct views in the process of learning a common representation in a unified latent subspace. Experimental results demonstrate that our method outperforms five state-of-the-art methods on various real-world datasets including images and documents.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. http://mlg.ucd.ie/datasets/3sources.html

  2. http://mlg.ucd.ie/datasets/bbc.html

  3. https://github.com/GPMVCDummy/GPMVC/tree/master/partialMV/PVC/recreateResults/data

  4. https://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html

  5. http://lig-membres.imag.fr/grimal/data.html

  6. https://www.cs.columbia.edu/CAVE/software/softlib/coil-20.php

  7. http://archive.ics.uci.edu/ml/datasets/multiple+features.html

  8. http://yann.lecun.com/exdb/mnist/

References

  1. Chao G, Sun J, Lu J, Wang AL, Bi J (2019) Multi-view cluster analysis with incomplete data to understand treatment effects. Inf Sci:494

  2. Xiao Q, Dai J, Luo J, Fujita H (2019) Multi-view manifold regularized learning-based method for prioritizing candidate disease mirnas. Knowl-Based Syst 175:118–129

    Article  Google Scholar 

  3. Zeng S, Wang X, Cui H, Zheng C, Feng D (2017) A unified collaborative multikernel fuzzy clustering for multiview data. IEEE Trans Fuzzy Syst 26(99):1671–1687

    Google Scholar 

  4. Zhang GY, Wang CD, Huang D, Zheng WS (2017) Multi-view collaborative locally adaptive clustering with minkowski metric. Expert Syst Appl 86:307–320

    Article  Google Scholar 

  5. Yin Q, Wu S, Wang L (2018) Multiview clustering via unified and view-specific embeddings learning. IEEE Transactions on Neural Networks and Learning Systems

  6. Abavisani M, Patel VM (2018) Multimodal sparse and low-rank subspace clustering. Inf Fusion 39:168–177

    Article  Google Scholar 

  7. Yin Q, Wu S, Wang L (2017) Unified subspace learning for incomplete and unlabeled multi-view data. Pattern Recogn 67:313–327

    Article  Google Scholar 

  8. Wang C-D, Chen M-S, Huang L, Lai J-H, Yu P (2020) Smoothness regularized multiview subspace clustering with kernel learning. IEEE Trans Neural Netw Learn Syst:PP

  9. Wang H, Yang Y, Liu B, Fujita H (2019) A study of graph-based system for multi-view clustering. Knowl-Based Syst 163(1):1009–1019

    Article  Google Scholar 

  10. Zhu X, Guo J, Nejdl W, Liao X, Dietze S (2020) Multi-view image clustering based on sparse coding and manifold consensus. Neurocomputing 403:53–62

    Article  Google Scholar 

  11. He T, Liu Y, Ko TH, Chan K CC, Ong YS (2019) Contextual correlation preserving multi-view featured graph clustering. IEEE Trans Cybern:PP(99)

  12. Yin M, Gao J, Xie S, Guo Y (2019) Multi-view subspace clustering via tensor t-product representation. IEEE Trans Neural Netw Learn Syst 30:851–864

    Article  MathSciNet  Google Scholar 

  13. Zhang Y, Yang Y, Li T, Fujita H (2019) A multitask multiview clustering algorithm in heterogeneous situations based on lle and le. Knowl-Based Syst 163(1):776–786

    Article  Google Scholar 

  14. Wen J, Xu Y, Liu H (2020) Incomplete multiview spectral clustering with adaptive graph learning. IEEE Trans Cybern 50(4):1418–1429

    Article  Google Scholar 

  15. Wen J, Zhang Z, Zhang Z, Fei L, Wang M (2020) Generalized incomplete multiview clustering with flexible locality structure diffusion. IEEE Trans Cybern PP(99):1–14

    Google Scholar 

  16. Yang L, Shen C, Hu Q, Jing L, Li Y (2020) Adaptive sample-level graph combination for partial multiview clustering. IEEE Trans Image Process 29:2780–2794

    Article  Google Scholar 

  17. Zhuge W, Luo T, Tao H, Hou C, Yi D (2020) Multi-view spectral clustering with incomplete graphs. IEEE Access PP(99):1–1

    Google Scholar 

  18. Cai Y, Jiao Y, Zhuge W, Tao H, Hou C (2018) Partial multi-view spectral clustering. Neurocomputing 311(15):316–324

    Article  Google Scholar 

  19. Li S, Jiang Y, Zhou Z (2014) Partial multi-view clustering. In: AAAI Conference on Artificial Intelligence, pp 1968– 1974

  20. Rai N, Negi S, Chaudhury S, Deshmukh O (2016) Partial multi-view clustering using graph regularized nmf. In: International Conference on Pattern Recognition, pp 2192–2197

  21. Shao W, He L, P.S. Y (2015) Multiple incomplete view clustering via weighted nonnegative matrix factorization with l21 regularization. Springer International Publishing

  22. Yin Q, Wu S, Wang L (2015) Incomplete multi-view clustering via subspace learning. In: ACM International Conference on Information and Knowledge Management, pp 383– 392

  23. Tao H, Hou C, Yi D, Zhu J, Hu D (2019) Joint embedding learning and low-rank approximation: A framework for incomplete multiview learning. IEEE Trans Cybern PP(99):1–14

    Google Scholar 

  24. Ji MS, Rao H, Li ZX, Zhu J, Wang N (2019) Partial multi-view clustering based on sparse embedding framework. IEEE Access:1–1

  25. Yang W, Shi Y, Gao Y, Wang L, Yang M (2018) Incomplete-data oriented multiview dimension reduction via sparse low-rank representation. IEEE Trans Neural Netw Learn Syst:1–16

  26. Shang C, Palmer A, Sun J, Chen KS, Lu J, Bi J (2017) Vigan: Missing view imputation with generative adversarial networks. In: IEEE International Conference on Big Data, pp 766– 775

  27. Wang Q, Ding Z, Tao Z, Gao Q, Fu Y (2018) Partial multi-view clustering via consistent gan. In: IEEE International Conference on Data Mining, pp 1290–1295

  28. Zhao L, Chen Z, Yang Y, Wang ZJ, Leung V CssM (2018) Incomplete multi-view clustering via deep semantic mapping. Neurocomputing 275(31):1053–1062

    Article  Google Scholar 

  29. Ji P, Zhang T, Li H, Salzmann M, Reid I (2017) Deep subspace clustering networks. Neural Inf Process Syst:24–33

  30. Fu J, Liu J, Jiang J, Li Y, Lu H (2020) Scene segmentation with dual relation-aware attention network. IEEE Trans Neural Netw Learn Syst PP(99):1–14

    Google Scholar 

  31. Lu, Zhao Z, Zhu L, Huang D, Yan S (2012) Robust and efficient subspace segmentation via least squares regression. European Conference on Computer Vision

  32. Elhamifar E, Vidal R (2013) Sparse subspace clustering: Algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35(11):2765–2781

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (NSFC) [grant numbers 61502175, 61273295]; and the Natural Science Foundation of Guangdong Province [grant number 2020A1515010699].

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiaolan Liu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xie, M., Ye, Z., Pan, G. et al. Incomplete multi-view subspace clustering with adaptive instance-sample mapping and deep feature fusion. Appl Intell 51, 5584–5597 (2021). https://doi.org/10.1007/s10489-020-02138-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-02138-9

Keywords

Navigation