A novel information-theoretic stepwise feature selector (ITSFS) is designed to reduce the dimension of diesel engine data. This data consist of 43 sensor measurements acquired from diesel engines that are either in a healthy state or in one of seven different fault states. Using ITSFS, the minimum number of sensors from a pool of 43 sensors is selected so that eight states of the engine can be classified with reasonable accuracy. Various classifiers are trained and tested for fault classification accuracy using the field data before and after dimension reduction by ITSFS. The process of dimension reduction and classification is repeated using other existing dimension reduction techniques such as simulated annealing and regression subset selection. The classification accuracies from these techniques are compared with those obtained by data reduced by the proposed feature selector.
Issue Section:
Technical Briefs
1.
Bell
, C. B.
, 1962, “Mutual Information and Maximal Correlation as Measure of Dependence
,” Ann. Math. Stat.
0003-4851, 33
, pp. 587
–595
.2.
Cover
, T.
, and Thomas
, J.
, 1993, Elements of Information Theory
, Wiley
, New York
.3.
Hyvärinen
, A.
, and Oja
, E.
, 2000, “Independent Component Analysis: Algorithms and Applications
,” Neural Networks
0893-6080, 13
(4–5
), pp. 411
–430
.4.
5.
Schwarz
, G.
, 1978, “Estimating the Dimension of a Model
,” Ann. Stat.
0090-5364, 6
(2
), pp. 461
–464
.6.
Mallows
, C.
, 1973, “Some Comments on Cp
,” Technometrics
0040-1706, 15
(4
), pp. 661
–675
.7.
Akaike
, H.
, 1974, “A New Look at the Statistical Model Identification
,” IEEE Trans. Autom. Control
0018-9286, 19
(6
), pp. 716
–723
.8.
Peng
, H.
, Long
, F.
, and Ding
, C.
, 2005, “Feature Selection Based on Mutual Information Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy
,” IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828, 27
(8
), pp. 1226
–1238
.9.
Warner
, B.
, and Misra
, M.
, 1996, “Understanding Neural Networks as Statistical Tools
,” Am. Stat.
0003-1305, 50
(4
), pp. 284
–293
.10.
Hastie
, T.
, Tibshirani
, R.
, and Friedman
, J.
, 2001, The Elements of Statistical Learning: Data Mining, Inference, and Prediction
, Springer
, New York
.11.
Vapnik
, V.
, 1999, “An Overview of Statistical Learning Theory
,” IEEE Trans. Neural Netw.
1045-9227, 10
(5
), pp. 988
–1000
.12.
Jain
, A.
, Duin
, P.
, and Mao
, J.
, 2000, “Statistical Pattern Recognition: A Review
,” IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828, 22
(1
), pp. 4
–37
.13.
Stoica
, P.
, and Selen
, Y.
, 2004, “Model Selection: A Review of Information Criterion Rules
,” IEEE Signal Process. Mag.
1053-5888, 21
(4
), pp. 36
–47
.14.
Liu
, H.
, and Motoda
, H.
, 1998, Feature Extraction Construction and Selection: A Data Mining Perspective
, 2nd ed., Kluwer Academic
, Boston
.15.
Hand
, D.
, 1997, Construction and Assessment of Classification Rules
, 2nd ed., Wiley
, Chichester
.16.
Gordon
, A.
, 1999, Classification
, Chapman and Hall/CRC
, Boca Raton
.17.
Deignan
, P. B.
, Meckl
, P. H.
, Franchek
, M. A.
, Zhu
, G. G.
, and Jaliwala
, S. A.
, 2000, “The Mutual Information-Radial Basis Function Network
,” Intelligent Engineering Systems Through Artificial Neural Networks
, ASME Press
, New York
, Vol. 10
, pp. 83
–90
.18.
Vasconcelos
, N.
, 2003. “A Family of Information-Theoretic Algorithms for Low-Complexity Discriminant Feature Selection in Image Retrieval
,” Proceedings of International Conference on Image Processing
, Vol. 3
, pp. 741
–744
.19.
Al-Ani
, A.
, and Deriche
, M.
, 2001. “An Optimal Feature Selection Technique Using the Concept of Mutual Information
,” International Symposium on Signal Processing and its Applications
, Vol. 2
, pp. 477
–480
.20.
Scott
, D. W.
, 1992, Multivariate Density Estimation: Theory, Practice, and Visualization
, Wiley
, London
.21.
Kwak
, N.
, and Chong-Ho
, C.
, 2002, “Input Feature Selection by Mutual Information Based on Parzen Window
,” IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828, 24
(12
), pp. 1667
–1671
.22.
Battiti
, R.
, 1994, “Using Mutual Information for Selecting Features in Supervised Neuralnet Learning
,” IEEE Trans. Neural Netw.
1045-9227, 5
(4
), pp. 537
–550
.23.
Cerdeira
, J.
, Silva
, P.
, Cadima
, J.
, and Minhoto
, M.
, 2005, ANNEAL, Subselect Package, the R project for statistical computing.24.
Lumley
, T.
, and Miller
, A.
, 2004, Regsubsets, Leaps Package, the R project for statistical computing.25.
Neter
, J.
, Kutner
, M. H.
, Wasserman
, W.
, and Nachtsheim
, C. J.
, 1996, Applied Linear Statistical Models
, McGraw-Hill
, New York
.Copyright © 2009
by American Society of Mechanical Engineers
You do not currently have access to this content.
