An accelerator for neural networks with pulse-coded model neurons

The labeling of features by synchronization of spikes seems to be a very efficient encoding scheme for a visual system. Simulation of a vision system with millions of pulse-coded model neurons, however, is almost impossible on the basis of available processors including parallel processors and neurocomputers. A "one-to-one" silicon implementation of pulse-coded model neurons suffers from communication problems and low flexibility. On the other hand, acceleration of the simulation algorithm of pulse-coded leaky integrator neurons has proved to be straightforward, flexible, and very efficient. Thus we decided to develop an accelerator for a special version of the French and Stein (1970) neurons with modulatory inputs which are advantageous for simulation of synchronization mechanisms. Moreover, our accelerator also provides a Hebbian-like learning rule and supports adaptivity. Up to 128 K neurons with a total number of 16 M freely allocatable synapses are simulated within one system. The size of networks, however, is not at all limited by these numbers as the system may be arbitrarily expanded. Simulation speed obviously depends on the number of interconnections and on the average activity within the network. In the case of locally interconnected networks for simulation of vision mechanisms there is only a very low percentage of simultaneously active neurons: stimuli are not simultaneously presented in all orientations and at all positions of the visual field. In these cases our accelerator provides close to real-time behavior if one second of a biological neuron is simulated by 1000 time slots.