Forward Propagation Neural Network Weighting Analysis as a Model Estimation Method

One of the main parameters that affect training process of feed-forward neural networks and final quality of the model is weights initialization. In this article different methods for analyzing weights matrices, which allow evaluation of the initial initialization quality, are presented. The considered methods make it possible to simplify parameters of weights initialization selection and increase the efficiency of neural networks training. All results are presented in the framework of regression problem.