Pixel Processor Arrays For Low Latency Gaze Estimation

We demonstrate the use of a Pixel Processor Array (PPA) vision sensor for achieving rates of over 10,000 Hz, with processing latency below 0.1 ms, in a gaze tracking application, performing image processing directly upon the sensor itself with minimal external computation. Each pixel processing element of the PPA sensor is capable of light sensing, data storage and computation, allowing various visual processing to be performed efficiently at the point of light capture. We demonstrate how information such as pupil location, size, and LED reflections upon the eye's surface can be extracted by the PPA, along with a simple gaze tracker using pupil location. By extracting such information directly on-sensor, the data needing to be transferred from sensor to external processing is reduced from entire images to a hand-full of contextual bytes, this provides significant saving in terms of power, time and allows for frame-rates far exceeding traditional camera sensors.