Skip to main content
SpringerLink
Log in

Joint Label-Specific Features and Correlation Information for Multi-Label Learning

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

Multi-label learning deals with the problem where each instance is associated with a set of class labels. In multi-label learning, different labels may have their own inherent characteristics for distinguishing each other, and the correlation information has shown promising strength in improving multi-label learning. In this study, we propose a novel multi-label learning method by simultaneously taking into account both the learning of label-specific features and the correlation information during the learning process. Firstly, we learn a sparse weight parameter vector for each label based on the linear regression model, and the label-specific features can be extracted according to the corresponding weight parameters. Secondly, we constrain label correlations directly on the output of labels, not on the corresponding parameter vectors which conflicts with the label-specific feature learning. Specifically, for any two related labels, their corresponding models should have similar outputs rather than similar parameter vectors. Thirdly, we also exploit the sample correlations through sparse reconstruction. The experimental results on 12 benchmark datasets show that the proposed method performs better than the existing methods. The proposed method ranks in the 1st place at 66.7% case and achieves optimal average rank in terms of all evaluation measures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. He Z Y, Wu J, Lv P. Multi-label text classification based on the label correlation mixture model. Intelligent Data Analysis Analysis, 2017, 21(6): 1371-1392.

    Article  Google Scholar 

  2. Kazawa H, Izumitani T, Taira H et al. Maximal margin labeling for multi-topic text categorization. In Proc. the 18th Annual Conference on Neural Information Processing Systems, December 2004, pp.649-656.

  3. de Almeida A M G, Ricardo C, Paraiso E C et al. Applying multi-label techniques in emotion identification of short texts. Neurocomputing, 2018, 320: 35-46.

    Article  Google Scholar 

  4. Li Y, Song Y, Luo J. Improving pairwise ranking for multi-label image classification. In Proc. the 30th IEEE Conference on Computer Vision and Pattern Recognition, July 2017, pp.1837-1845.

  5. Tan M, Shi Q, van den Hengel A et al. Learning graph structure for multi-label image classification via clique generation. In Proc. the 28th IEEE Conference on Computer Vision and Pattern Recognition, June 2015, pp.4100-4109.

  6. Sun F, Tang J, Li H et al. Multi-label image categorization with sparse factor representation. IEEE Transactions on Image Processing, 2014, 23(3): 1028-1037.

    Article  MathSciNet  MATH  Google Scholar 

  7. Trohidis K, Tsoumakas G, Kalliris G et al. Multi-label classification of music into emotions. In Proc. the 9th International Conference on Music Information Retrieval, September 2008, pp.325-330.

  8. Wu B, Zhong E, Horner A et al. Music emotion recognition by multi-label multi-layer multi-instance multi-view learning. In Proc. the 22nd ACM International Conference on Multimedia, November 2014, pp.117-126.

  9. Zhang M L, Zhou Z H. A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering, 2014, 26(8): 1819-1837.

    Article  Google Scholar 

  10. Zhou Z H, Zhang M L. Multi-label learning. In Encyclopedia of Machine Learning and Data Mining, Sammut C, Webb G (eds.), Springer, 2016.

  11. Zhang M L, Wu L. Lift: Multi-label learning with label-specific features. In Proc. the 22nd International Joint Conference on Artificial Intelligence, July 2011, pp.1609-1614.

  12. Huang J, Li G, Huang Q et al. Learning label specific features for multi-label classification. In Proc. the 15th IEEE International Conference on Data Mining, November 2015, pp.181-190.

  13. Huang J, Li G, Huang Q et al. Joint feature selection and classification for multi-label learning. IEEE Transactions on Cybernetics, 2018, 48(3): 876-889.

    Article  Google Scholar 

  14. Han H, Huang M, Zhang Y et al. Multi-label learning with label specific features using correlation information. IEEE Access, 2019, 7: 11474-11484.

    Article  Google Scholar 

  15. Elisseeff A, Weston J. A kernel method for multi-labelled classification. In Proc. the 15th Annual Conference on Neural Information Processing Systems, December 2001, pp.681-687.

  16. Tsoumakas G, Katakis I, Vlahavas I. Random k-labelsets for multilabel classification. IEEE Transactions on Knowledge and Data Engineering, 2011, 23(7): 1079-1089.

    Article  Google Scholar 

  17. Zhang Q W, Zhong Y, Zhang M L. Feature-induced labeling information enrichment for multi-label learning. In Proc. the 32nd AAAI Conference on Artificial Intelligence, February 2018, pp.4446-4453.

  18. Zhang J, Li C, Cao D et al. Multi-label learning with label-specific features by resolving label correlations. Knowledge-Based Systems, 2018, 159: 148-157.

    Article  Google Scholar 

  19. Roweis S T, Saul L K. Nonlinear dimensionality reduction by locally linear embedding. Science, 2000, 290(5500): 2323-2326.

    Article  Google Scholar 

  20. Read J, Pfahringer B, Holmes G et al. Classifier chains for multi-label classification. Machine Learning, 2011, 85(3): 333-359.

    Article  MathSciNet  Google Scholar 

  21. Boutell M R, Luo J, Shen X et al. Learning multi-label scene classification. Pattern Recognition, 2004, 37(9): 1757-1771.

    Article  Google Scholar 

  22. Furnkranz J, Hüllermeier E, Mencia E L et al. Multi-label classification via calibrated label ranking. Machine Learning, 2008, 73(2): 133-153.

    Article  Google Scholar 

  23. Zhang M L, Zhang K. Multi-label learning by exploiting label dependency. In Proc. the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, July 2010, pp.999-1008.

  24. Xu S, Yang X, Yu H et al. Multi-label learning with label-specific feature reduction. Knowledge-Based Systems, 2016, 104: 52-61.

    Article  Google Scholar 

  25. Yan Y, Li S, Yang Z et al. Multi-label learning with label-specific feature selection. In Proc. the 24th International Conference on Neural Information Processing, November 2017, pp.305-315.

  26. Huang S J, Zhou Z H. Multi-label learning by exploiting label correlations locally. In Proc. the 26th AAAI Conference on Artificial Intelligence, July 2012, pp.949-955.

  27. Lin Z, Ganesh A, Wright J et al. Fast convex optimization algorithms for exact recovery of a corrupted low-rank matrix. Technical Report, University of Illinois at Urbana-Champaign, 2009. https://www.ideals.illinois.edu/bitstream/handle/2142/74352/B40-DC_246.pdf?sequence=2&isAllowed=y, Dec. 2019.

  28. Demisar J. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 2006, 7(1): 1-30.

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, 210094, China

    Xiu-Yi Jia & Sai-Sai Zhu

  2. College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China

    Wei-Wei Li

Authors
  1. Xiu-Yi Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sai-Sai Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei-Wei Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiu-Yi Jia.

Electronic supplementary material

ESM 1

(PDF 308 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jia, XY., Zhu, SS. & Li, WW. Joint Label-Specific Features and Correlation Information for Multi-Label Learning. J. Comput. Sci. Technol. 35, 247–258 (2020). https://doi.org/10.1007/s11390-020-9900-z

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-020-9900-z

Keywords

Search

Navigation