Multilayer Incremental Hybrid Cost-Sensitive Extreme Learning Machine With Multiple Hidden Output Matrix and Subnetwork Hidden Nodes

Recently, multilayer extreme learning machine with subnetwork nodes and cost sensitive learning was applied to representation learning and classification. However, the existing ML-ELM methods suffer from several drawbacks: 1) manual tuning for the number of hidden nodes in each layer will influent the training speed of the model, the best optimal determine approach for the number of hidden nodes is still for probing; 2) random projection of the input weight and bias in each layer still suboptimal and the network structure hard to reach best generalization performance. Inspired by the Subnetwork nodes and cost sensitive methods, using multiple hidden output matrix, a novel ELM method which called Multilayer Incremental Hybrid Cost Sensitive Extreme Learning Machine with Multiple Hidden Output Matrix and Subnetwork Hidden Nodes is proposed in this paper. Whose contributions are 1) a hybrid hidden nodes optimization methods is given which based on ant clone method and multiple grey wolf optimization method; 2) a multiple hidden layer output matrices are being using through weighted calculation of different output matrices which can optimize the network architecture effectively; 3) a novel ELM structure is proposed by merging the merits of Cost Sensitive Extreme Learning Machine and Subnetwork Hidden Nodes, while the regularized parameter
$C$
is not sensitive to the generalization performance. Extensive experiments results show that the proposed method achieves better performance than existing state-of-art ELM methods.