Development of An Extended Robust Data Mining (ERDM) Model

Most data mining (DM) methods reviewed in literature for the factor selection may obtain a number of input factors associated with the interesting response without providing the detailed information, such as relationship between the input factors and response, statistical inferences, and analysis. These DM methods also may not discuss the robustness of solutions, either by considering data preprocesses for outliers and missing values, or by considering uncontrollable noise factors. In order to address these problems, we propose an extended robust data mining (ERDM) model. The main concerns of this model are three-fold. The proposed ERDM conducts outlier test and expectation maximum (EM) algorithm to carry out the data preprocess. The proposed ERDM then reduces the dimensionality to find the significant factors among a large number of input factors using correlation-based feature selection (CBFS) method and best first search (BFS) algorithm. Finally, the proposed model utilizes the theory of robust design to handle the noise factors using the concept of surrogate variable and the response surface methodology (RSM).