Cart (Loading....) | Create Account
Close category search window
 

Double cross-validation for performance evaluation of multi-objective genetic fuzzy systems

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
Ishibuchi, H. ; Dept. of Comput. Sci. & Intell. Syst., Osaka Prefecture Univ., Sakai, Japan ; Nakashima, Y. ; Nojima, Yusuke

We propose an idea of using repeated double cross-validation to evaluate the generalization ability of multi-objective genetic fuzzy systems (MoGFS). The main advantage of MoGFS approaches is that a large number of non-dominated fuzzy rule-based systems are obtained by their single run. Each of the obtained fuzzy rule-based systems has a different tradeoff with respect to conflicting objectives such as accuracy and complexity. One controversial issue in the MoGFS field (and also in the field of multi-objective optimization in general) is how to choose the final solution from the obtained non-dominated ones. Since this selection is supposed to be done by human users, it is very difficult to rigorously discuss the generalization ability of the finally-selected fuzzy rule-based system. To tackle this difficulty, we propose the use of double cross-validation in the performance evaluation of MoGFS approaches. Double cross-validation has a nested structure of two cross-validation loops. The inner loop is used to determine the best complexity of fuzzy rule-based systems with the highest generalization ability for the training data in each run in the outer loop. That is, the inner loop plays the role of validation data. The determined best complexity is used to choose the final fuzzy rule-based system in each run in the outer loop. We explain the proposed idea by applying it to the performance evaluation of fuzzy rule-based classifiers designed by our multi-objective fuzzy genetics-based machine learning algorithm.

Published in:

Genetic and Evolutionary Fuzzy Systems (GEFS), 2011 IEEE 5th International Workshop on

Date of Conference:

11-15 April 2011

Need Help?


IEEE Advancing Technology for Humanity About IEEE Xplore | Contact | Help | Terms of Use | Nondiscrimination Policy | Site Map | Privacy & Opting Out of Cookies

A not-for-profit organization, IEEE is the world's largest professional association for the advancement of technology.
© Copyright 2014 IEEE - All rights reserved. Use of this web site signifies your agreement to the terms and conditions.