By Topic

A comparison of ensemble methods for multilayer feedforward networks

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

The purchase and pricing options are temporarily unavailable. Please try again later.
3 Author(s)
C. Hernandez-Espinosa ; Univ. Jaume I, Castellon, Spain ; M. Fernandez-Redondo ; M. Ortiz-Gomez

Training an ensemble of networks is an interesting way to improve the performance with respect to a single network. However there are several methods to construct the ensemble and there are no complete results showing which one could be the most appropriate. In this paper we present a comparison of eleven different methods. We have trained ensembles of a reduced number of networks (3 and 9) because in this case the computational cost is not high and the method is suitable for applications. The results show that the improvement in performance from three to nine networks is marginal. Also, the best method is called "Decorrelated" and uses a penalty term in the usual backpropagation function to decorrelate the network outputs in the ensemble.

Published in:

Neural Networks, 2003. Proceedings of the International Joint Conference on  (Volume:4 )

Date of Conference:

20-24 July 2003