Self-creating and organizing neural networks with weight duplication

We propose a new self-creating and self-organizing neural networks utilizing weight duplication. The proposed model consists of competitive and input layers. Weights of the activated node are modified by competitive learning. A new node is created depending on the activation frequency. The weights of a daughter node are duplicated from the mother node. The mother node has refractory period just after the creation. The weights of the daughter node and those of her mother node will be similar after the refractory period. A mother-daughter relationship represents the hierarchical structure of input data. It is possible to organize the column by itself with similar features which has hierarchical structure. The represented features will become precise when descending the hierarchy. Some simulations are carried out to show the feasibility of the proposed model.