Dataflow and System Organization for Image Sensor Data Processing

In this paper, investigation on integration of image sensor into image processing system has been performed. Special attention is paid to the peculiarities of acquisition measurements from sensor and further transfer obtained data to the processing software. We devise general approach to fetching data from sensor and then implement it for two control modules - microcontroller and Field-Programmable Gate Array (FPGA). According to the proposed dataflow, general structure of the system is suggested. Mathematical apparatus for assessment of the expected throughput has been provided for the specific sensor to evaluate performance of the system on the lowest level. For practical testing, image sensor TSL3301 from AMS company was employed. Results of image acquisition under different configuration settings and comparative analysis of the images are provided in the paper. To complete the whole processing flow we implemented software that assembles image from sensor measurements and visualizes data. The proposed technology stack for image sensor system is intended to be used as fundamental part for intellectual functions.