Journal of Systems Engineering and Electronics ›› 2012, Vol. 34 ›› Issue (5): 1046-1050.doi: 10.3969/j.issn.1001-506X.2012.05.34

Previous Articles     Next Articles

Ensemble feature selection algorithm based on Markov blanket and mutual information

YAO Xu, WANG Xiao-dan, ZHANG Yu-xi, QUAN Wen   

  1. Missile Institute, Air Force Engineering University, Sanyuan 713800, China
  • Online:2012-05-23 Published:2010-01-03

Abstract:

To resolve the poor performance of classifiers owing to the irrelevant and redundancy features, a feature selection  algorithm based on approximate Markov blanket and dynamic mutual information is proposed, then it is introduced to an ensemble feature selection algorithm. In the ensemble algorithm, a base classifier is trained based on Bagging and the  proposed feature selection algorithm, and the base classifier diversity is introduced to selective ensemble. Finally, the  weighted voting method is utilized to fuse the base classifiers’ recognition results. To attest the validity,  experiments on data sets with support vector machine (SVM) as the classifier are carried out. The results have been  compared with singleSVM, BaggingSVM and ABSVM. Experimental results suggest that the proposed algorithm can get  higher classification accuracy.

[an error occurred while processing this directive]