中文

Journal of Shanghai University >

2021 , Vol. 27 >Issue 3: 525 - 534

DOI: https://doi.org/10.12066/j.issn.1007-2861.2132

Research Articles

Label-specific feature-based multi-label manifold learning

Expand
  • School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China

Received date: 2018-12-10

  Online published: 2021-06-27

Fold

Abstract

Multi-label manifold learning (ML$^2$) constructs label manifolds based on feature manifolds and converts logical into numeric labels. This can better reflect the correlations between labels and improve classification performance. However, similar to most methods, ML$^2$ is based on all features and ignores different discriminabilities when different features are used to classify different labels. Therefore, a method we call label-specific feature-based multi-label manifold learning (LSF-ML$^2$) is proposed. First, the labels are used to optimise the feature importance matrix, which can determine the subset of label-specific features. Then, the feature manifold of the subset is mapped to the label space so that the logical labels can be converted into numeric labels. Finally, a multi-output regression is applied for classification. Experimental results show that the proposed method outperforms several existing multi-label classification methods.

Key words： multi-label learning; classification; label-specific feature; manifold learning; label correlation

Cite this article

KANG Liuyue, HUANG Rui, SUN Guangling . Label-specific feature-based multi-label manifold learning[J]. Journal of Shanghai University, 2021 , 27(3) : 525 -534 . DOI: 10.12066/j.issn.1007-2861.2132

References

[1] 龚露鸣, 徐美华, 刘冬军, 等. 基于混合高斯和 HOG+SVM 的行人检测模型[J]. 上海大学学报(自然科学版), 2018,24(3):341-351.
[1] Gong L M, Xu M H, Liu D J, et al. Novel model of pedestrian detection based on Gaussian mixture model and HOG+SVM[J]. Journal of Shanghai University (Natural Science Edition), 2018,24(3):341-351.
[2] Wang X, Liu H, Yang Z, et al. Research and implementation of a multi-label learning algorithm for Chinese text classification[C]// International Conference on Big Data Computing and Communications. 2017: 68-76.
[3] Liu J, Chang W C, Wu Y, et al. Deep learning for extreme multi-label text classification[C]// International ACM SIGIR Conference on Research and Development in Information Retrieval. 2017: 115-124.
[4] Boutell M R, Luo J, Shen X, et al. Learning multi-label scene classification[J]. Pattern Recognition, 2004,37(9):1757-1771.
[5] Sun F, Tang J, Li H, et al. Multi-label image categorization with sparse factor representation[J]. IEEE Transactions on Image Processing, 2014,23(3):1028-1037.
[6] Trohidis K, Tsoumakas G, Kalliris G, et al. Multi-label classification of music by emotion[J]. EURASIP Journal on Audio, Speech, and Music Processing, 2011,2011(1):1-9.
[7] Wu B, Zhong E, Horner A, et al. Music emotion recognition by multi-label multi-layer multi-instance multi-view learning[C]// ACM International Conference on Multimedia. 2014: 117-126.
[8] Read J, Pfahringer B, Holmes G, et al. Classifier chains for multi-label classification[J]. Machine Learning, 2011,85(3):333-359.
[9] Tsoumakas G, Katakis I, Vlahavas I. Random $k$-labelsets for multilabel classification[J]. IEEE Transactions on Knowledge and Data Engineering, 2011,23(7):1079-1089.
[10] Zhang M L, Zhou Z H. ML-KNN: a lazy learning approach to multi-label learning[J]. Pattern Recognition, 2007,40(7):2038-2048.
[11] Elisseeff A, Weston J. A kernel method for multi-labelled classification[C]// Advances in Neural Information Processing Systems. 2002: 681-687.
[12] Zhang M L, Zhou Z H. Multilabel neural networks with applications to functional genomics and text categorization[J]. IEEE Transactions on Knowledge and Data Engineering, 2006,18(10):1338-1351.
[13] Hou P, Geng X, Zhang M L. Multi-label manifold learning[C]// Thirtieth AAAI Conference on Artificial Intelligence. 2016: 1680-1686.
[14] Zhang Q W, Zhong Y, Zhang M L. Feature-induced labeling information enrichment for multi-label learning[C]// AAAI Conference on Artificial Intelligence. 2018: 4446-4453.
[15] Liu B, Xu Z, Wu S, et al. Manifold regularized matrix completion for multilabel classification[J]. Pattern Recognition Letters, 2016,80:58-63.
[16] Liu B, Li Y, Xu Z. Manifold regularized matrix completion for multi-label learning with ADMM[J]. Neural Networks, 2018,101:57-67.
[17] Zhu Y, Kwok J T, Zhou Z H. Multi-label learning with global and local label correlation[J]. IEEE Transactions on Knowledge and Data Engineering, 2018,30(6):1081-1094.
[18] Cai Z, Zhu W. Multi-label feature selection via feature manifold learning and sparsity regularization[J]. International Journal of Machine Learning and Cybernetics, 2018,9(8):1321-1334.
[19] Huang R, Jiang W, Sun G. Manifold-based constraint Laplacian score for multi-label feature selection[J]. Pattern Recognition Letters, 2018,112:346-352.
[20] Zhang M L. LIFT: multi-label learning with label-specific features[C]// International Joint Conference on Artificial Intelligence. 2011: 1609-1614.
[21] Huang J, Li G, Huang Q, et al. Learning label specific features for multi-label classification[C]// IEEE International Conference on Data Mining. 2015: 181-190.
[22] Tsoumakas G, Katakis I, Vlahavas I. Mining multi-label data[M]. Boston: Springer, 2009: 667-685.
[23] Zhang M L, Zhou Z H. A review on multi-label learning algorithms[J]. IEEE Transactions on Knowledge and Data Engineering, 2014,26(8):1819-1837.
Options
Outlines

/

〈 〉