Optimal feed-forward neural networks based on the combination of constructing and pruning by genetic algorithms

The determination of the proper size of an artificial neural network (ANN) is recognized to be crucial, especially for its practical implementation in important issues such as learning and generalization. In the paper, an effective design method of neural network architectures is presented. The network is firstly trained by a dynamic constructive method until the error is satisfied. The trained network is then pruned by genetic algorithm (GA). The simulation results demonstrate the advantages in generalization and expandability of the proposed method.