A delta rule algorithm using double hysteresis thresholds for recurrent associative memory

An associative memory using fixed and variable hysteresis thresholds in learning and recalling processes, respectively, has been proposed by the authors. This model can achieve a large memory capacity and very low noise sensitivity. However, a relation between weight change /spl Delta/w and the hysteresis threshold /spl plusmn/T has not been well discussed. In this paper, a new learning algorithm is proposed, which is based on a delta rule. However, in order to stabilize the learning process, a method of using double hysteresis thresholds is proposed. Unit states are updated using /spl plusmn/T. The error, used for adjusting weights, is evaluated using /spl plusmn/(T+dT): this means 'over correction'. Stable and fast convergence can be obtained. Relations between /spl eta/=dT/T and convergence rate and noise sensitivity are discussed, resulting the optimum selection for /spl eta/. Furthermore, the order of presenting training data is optimized taking correlation into account. In the recalling process, a threshold control method is further proposed in order to achieve fast recalling from noisy patterns.<>