Ultra-low bandwidth video streaming using a neuromorphic, scene-driven image sensor

This live demonstration shows ultra-low bandwidth video streaming based on a scene-driven event-encoding imaging sensor. The approach exploits the inherent focal-plane redundancy suppression / video compression achieved by an array of autonomous, auto-sampling pixels. The data readout from the camera is optimized for transmission bandwidth using variable bit-length pixel address encoding and spatio-temporal pre-filtering of the raw image data, resulting in instantaneous bit rates that vary between 0bps and a set rate, e.g. 256kbps, only depending on scene activity. The demonstrated device is a small form-factor stand-alone camera that, besides the sensor and optics, includes hardware-based data encoding and filtering, and a wireless data transmission module. The device is designed for e.g. surveillance applications in resource-limited environments such as sensor-networks or IoT.