Systems Engineering and Electronics ›› 2021, Vol. 43 ›› Issue (8): 2197-2208.doi: 10.12305/j.issn.1001-506X.2021.08.22
• Systems Engineering • Previous Articles Next Articles
Langcai CAO1,2,*, Xiaochang LIN1,2, Sixing SU1,2
Received:
2020-10-26
Online:
2021-07-23
Published:
2021-08-05
Contact:
Langcai CAO
CLC Number:
Langcai CAO, Xiaochang LIN, Sixing SU. Unsupervised feature selection based on matrix factorization and adaptive graph[J]. Systems Engineering and Electronics, 2021, 43(8): 2197-2208.
Table 1
Summary information and feature selection dimensions of the dataset"
数据集 | 样本数 | 特征维度 | 类别数 | 选择的特征个数 |
PalmData25 | 2 000 | 256 | 100 | [5, 10, …, 50] |
ECOLI | 336 | 343 | 8 | [5, 10, …, 50] |
ISOLET | 1 560 | 617 | 26 | [5, 10, …, 50] |
JAFFE | 213 | 676 | 10 | [5, 10, …, 50] |
YALE | 165 | 1 024 | 15 | [5, 10, …, 50] |
COIL20 | 1 440 | 1 024 | 20 | [50, 60, …, 150] |
Table 2
Optimal recognition rate comparison of algorithms %"
数据集 | PalmData25 | ECOLI | ISOLET | JAFFE | YALE | COIL20 | AVERAGE |
Baseline | 68.41 | 57.44 | 56.55 | 72.85 | 38.64 | 59.17 | 58.84 |
LapScore | 62.88 | 59.75 | 53.65 | 73.93 | 41.85 | 57.22 | 58.21 |
UDFS | 67.79 | 59.93 | 54.85 | 72.93 | 39.76 | 56.59 | 58.64 |
NDFS | 69.29 | 61.43 | 60.19 | 76.03 | 38.67 | 63.28 | 61.48 |
FASAL | 68.07 | 65.46 | 59.93 | 73.12 | 38.88 | 61.56 | 61.17 |
SOGFS | 67.89 | 63.66 | 55.48 | 75.65 | 43.33 | 62.00 | 61.34 |
MFAGFS | 69.43 | 73.04 | 62.92 | 80.39 | 44.15 | 63.01 | 65.49 |
Table 3
Optimal standard mutual information comparison of algorithms %"
数据集 | PalmData25 | ECOLI | ISOLET | JAFFE | YALE | COLI20 | AVERAGE |
Baseline | 90.24 | 55.48 | 1.26 | 81.17 | 46.48 | 75.58 | 58.37 |
LapScore | 86.99 | 60.16 | 0.39 | 83.48 | 49.18 | 71.38 | 58.60 |
UDFS | 89.14 | 59.86 | 0.72 | 78.39 | 48.97 | 71.30 | 58.06 |
NDFS | 89.89 | 60.26 | 3.16 | 85.80 | 46.51 | 73.02 | 59.77 |
FASAL | 89.48 | 60.57 | 3.18 | 80.58 | 46.27 | 74.72 | 59.13 |
SOGFS | 89.53 | 60.35 | 0.89 | 83.92 | 52.98 | 76.37 | 60.67 |
MFAGFS | 89.74 | 62.63 | 4.88 | 85.40 | 54.49 | 78.17 | 62.55 |
1 | 包芳, 殷柯欣. 特征选择算法综述及进展研究[J]. 科技风, 2020, (6): 231. |
BAO F , YIN K X . Review and progress of feature selection algorithms[J]. Science and Technology Wind, 2020, (6): 231. | |
2 | NIE F P, XIANG S M, JIA Y Q, et al. Trace ratio criterion for feature selection[C]//Proc. of the 23rd AAAI Conference on Artificial Intelligence, 2008: 671-676. |
3 | YANG Y, SHEN H T, MA Z, et al. L21-norm regularized discriminative feature selection for unsupervised learning[C]//Proc. of the 22nd International Joint Conference on Artificial Intelligence, 2011: 1589-1594. |
4 | CAI D, HE X, HAN J W. Spectral regression: a unified approach for sparse subspace learning[C]//Proc. of the IEEE 7th International Conference on Data Mining, 2007: 73-82. |
5 | CAI D, ZHANG C Y, HE X F. Unsupervised feature selection for multi-cluster data[C]//Proc. of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2010. |
6 | ZHAO Z, WANG L, LIU H. Efficient spectral feature selection with minimum redundancy[C]//Proc. of the 24th AAAI Conference on Artificial Intelligence, 2010: 673-678. |
7 | LIU X W , WANG L , ZHANG J . Global and local structure preservation for feature selection[J]. IEEE Trans.on Neural Networks & Learning Systems, 2014, 25 (6): 1083- 1095. |
8 | HOU C P , NIE F P , LI X L , et al. Joint embedding learning and sparse regression: a framework for unsupervised feature selection[J]. IEEE Trans.on Cybern, 2013, 44 (6): 793- 804. |
9 | QIAN M J, ZHAI C X. Robust unsupervised feature selection[C]//Proc. of the 23rd International Joint Conference on Artificial Intelligence, 2013. |
10 | LI Z C, YANG Y, LIU J, et al. Unsupervised feature selection using nonnegative spectral analysis[C]//Proc. of the 26th AAAI Conference on Artificial Intelligence, 2012: 1026-1032. |
11 | SHI L, DU L, SHEN Y D, et al. Robust spectral learning for unsupervised feature selection[C]//Proc. of the International Conference on Data Mining, 2014: 977-982. |
12 | ZENG H , CHEUNG Y M . Feature selection and kernel learning for local learning-based clustering[J]. IEEE Trans.on Software Engineering, 2010, 33 (8): 1532- 1547. |
13 | DU L, SHEN Y D. Unsupervised feature selection with adaptive structure learning[EB/OL]. [2020-10-26]. https://arxiv.org/abs/1504.00736. |
14 | NIE F P, ZHU W, LI X L. Unsupervised feature selection with structured graph optimization[C]//Proc. of the 30th AAAI Conference on Artificial Intelligence, 2016: 1302-1308. |
15 | DU S Q , MA Y D , LI S L , et al. Robust unsupervised feature selection via matrix factorization[J]. Neurocomputing, 2017, 241 (7): 115- 127. |
16 | 占善华, 武继刚, 房小兆. 自适应图嵌入的鲁棒稀疏局部保持投影[J]. 计算机工程与设计, 2020, 41 (8): 2296- 2301. |
ZHAN S H , WU J G , FANG X Z . Robust sparse locally preserving projection for adaptive graph embedding[J]. Computer Engineering and Design, 2020, 41 (8): 2296- 2301. | |
17 | CAI D , HE X F , HAN J W , et al. Graph regularized nonnegative matrix factorization for data representation[J]. IEEE Trans.on Pattern Analysis & Machine Intelligence, 2011, 33 (8): 1548- 1560. |
18 | HUANG J , NIE F P , HUANG H , et al. Robust manifold nonnegative matrix factorization[J]. ACM Trans.on Knowledge Discovery from Data (TKDD), 2014, 8 (3): 1- 21. |
19 | TAO H , HOU C P , NIE F P , et al. Effective discriminative feature selection with nontrivial solution[J]. IEEE Trans.on Neural Networks and Learning Systems, 2017, 27 (4): 796- 808. |
20 |
WANG X D , ZHANG X , ZENG Z Q , et al. Unsupervised spectral feature selection with l1-norm graph[J]. Neurocomputing, 2016, 200, 47- 54.
doi: 10.1016/j.neucom.2016.03.017 |
21 | NIE F P, WANG X Q, HUANG H. Clustering and projected clustering with adaptive neighbors[C]//Proc. of the ACM International Conference on Knowledge Discovery & Data Mining, 2014. |
22 | CHUNG F R K . Spectral graph theory, regional conference series in math[M]. America: American Mathematical Society, 1997. |
23 | NIE F P, WANG X Q, JORDAN M I, et al. The constrained laplacian rank algorithm for graph-based clustering[C]//Proc. of the 13th AAAI Conference on Artificial Intelligence: 1969-1976. |
24 | FAN K . On a theorem of Weyl concerning eigenvalues of linear transformations Ⅱ[J]. Proceedings of the National Academy of Sciences, 1950, 35 (1): 652- 655. |
25 |
高小方. 流形学习方法中的若干问题分析[J]. 计算机科学, 2009, 36 (4): 25- 28, 59.
doi: 10.3969/j.issn.1002-137X.2009.04.006 |
GAO X F . Analysis of some problems in manifold learning method[J]. Computer Science, 2009, 36 (4): 25- 28, 59.
doi: 10.3969/j.issn.1002-137X.2009.04.006 |
|
26 | BOYD S , PARIKH N , CHU E , et al. Distributed optimization and statistical learning via the alternating direction method of multipliers[J]. Foundations and Trends in Machine Learning, 2011, 3 (1): 1- 122. |
27 |
BOYD V F . Convex optimization[J]. IEEE Trans.on Automatic Control, 2006, 51 (11): 1859- 1859.
doi: 10.1109/TAC.2006.884922 |
28 | NIE F P, HUANG H, CAI X, et al. Efficient and robust feature selection via joint l2, 1-norms minimization[C]//Proc. of the Advances in Neural Information Processing Systems 23: Conference on Neural Information, 2010. |
29 | MOKLYACHUK M . Convex optimization: introductory course[M]. America: John Wiley & Sons, 2021. |
30 | HE X F, CAI D, NIYOGI P. Laplacian score for feature selection[C]//Proc. of the Advances in Neural Information Processing Systems 18, 2005: 505-512. |
[1] | Liru YANG, Yongxiang LIU, Wei YANG. Radar clutter amplitude statistical model selection based on transfer learning [J]. Systems Engineering and Electronics, 2022, 44(8): 2457-2467. |
[2] | Bo LI, Jiahao ZHOU, Minmin LIU, Pinchao ZHU. Feature selection for welding defect assessment based on improved NSGA3 [J]. Systems Engineering and Electronics, 2022, 44(7): 2211-2218. |
[3] | Guan WANG, Haizhong RU, Dali ZHANG, Guangcheng MA, Hongwei XIA. Design of intelligent control system for flexible hypersonic vehicle [J]. Systems Engineering and Electronics, 2022, 44(7): 2276-2285. |
[4] | Jiangmei CHEN, Wende ZHANG. Point-of-interest recommendation algorithm based on grey relational analysis and temporal-spatial preference feature [J]. Systems Engineering and Electronics, 2022, 44(6): 1934-1941. |
[5] | Juan WEI, Huangwei YANG, Fangli NING. Acoustic scene classification based on joint optimization of NMF and CNN [J]. Systems Engineering and Electronics, 2022, 44(5): 1433-1438. |
[6] | Wenhai WU, Xiaofeng GUO, Siyu ZHOU, Li GAO. Self-adaptive differential evolution algorithm with random neighborhood-based strategy and generalized opposition-based learning [J]. Systems Engineering and Electronics, 2021, 43(7): 1928-1942. |
[7] | Zhigang JIN, Tong WU. Intrusion detection based on feature selection and tree Parzen estimation [J]. Systems Engineering and Electronics, 2021, 43(7): 1954-1960. |
[8] | Ruifeng LI, Aiqiang XU, Weichao SUN, Shuyou WANG. Recommendation method for avionics feature selection algorithm basedon meta-learning [J]. Systems Engineering and Electronics, 2021, 43(7): 2011-2020. |
[9] | Wenhai WU, Xiaofeng GUO, Siyu ZHOU, Li GAO. Improved differential evolution algorithm for solving weapon-targetassignment problem [J]. Systems Engineering and Electronics, 2021, 43(4): 1012-1021. |
[10] | Yunhao SHI, Hua XU, Wanze ZHENG, Yinghui LIU. Few-shot modulation recognition method based on ensemble learning and feature dimension reduction [J]. Systems Engineering and Electronics, 2021, 43(4): 1099-1109. |
[11] | Hongguang LI, Ying GUO, Ping SUI, Zisen QI, Linghua SU. Fine feature recognition of frequency hopping radio based on high dimensional feature selection [J]. Systems Engineering and Electronics, 2020, 42(2): 445-451. |
[12] | Guoming XU, Hongwu YUAN, Mogen XUE, Feng WANG. Full polarization parameters low-rank and sparse factorization for pseudo color image fusion [J]. Systems Engineering and Electronics, 2020, 42(11): 2450-2460. |
[13] | Baokui WANG, Lin WU, Xiaofeng HU, Xiaoyuan HE, Shengming GUO. Operations command behavior knowledge representation learning method based on sequential graph [J]. Systems Engineering and Electronics, 2020, 42(11): 2520-2528. |
[14] | ZHANG Yan, WANG Cunsong, LU Ningyun, JIANG Bin. Remaining useful life prediction for aeroengine based on thesimilarity of degradation characteristics [J]. Systems Engineering and Electronics, 2019, 41(6): 1414-1421. |
[15] | YANG Yi, WANG Dongsheng, SONG Wenjie, FU Mengyin. Dynamic video stitching method embracing image semantics [J]. Systems Engineering and Electronics, 2018, 40(12): 2845-2854. |
Viewed | ||||||
Full text |
|
|||||
Abstract |
|
|||||