A Relationship Between Two Types of Two-Layer Threshold-Element Pattern-Recognition Networks

The two-layer threshold-element networks with feed-forward connections can be classified into two types, according to whether the inputs are fed directly to the second layer (Type II) or not (Type I). It is shown that there always exists a Type I network (with an appropriate number of elements in the first layer) which realizes the same discriminant function as that of any given Type II network; furthermore, parameters of the Type I network are determined only by that of the Type II network.