Feature selection for Bayesian network classifiers using the MDL-FS score

• Autores: Madalina M. Drugan, Marca A. Wiering
• Localización: International journal of approximate reasoning, ISSN 0888-613X, Vol. 51, Nº 6, 2010, págs. 695-717
• Idioma: inglés
• Texto completo no disponible (Saber más ...)
• Resumen

  • When constructing a Bayesian network classifier from data, the more or less redundant features included in a dataset may bias the classifier and as a consequence may result in a relatively poor classification accuracy. In this paper, we study the problem of selecting appropriate subsets of features for such classifiers. To this end, we propose a new definition of the concept of redundancy in noisy data. For comparing alternative classifiers, we use the Minimum Description Length for Feature Selection (MDL-FS) function that we introduced before. Our function differs from the well-known MDL function in that it captures a classifier�s conditional log-likelihood. We show that the MDL-FS function serves to identify redundancy at different levels and is able to eliminate redundant features from different types of classifier. We support our theoretical findings by comparing the feature-selection behaviours of the various functions in a practical setting. Our results indicate that the MDL-FS function is more suited to the task of feature selection than MDL as it often yields classifiers of equal or better performance with significantly fewer attributes.