Real-time single FPGA-based multimodal image fusion system

The real-time hardware system called UFO1 intended for high quality registering and fusion of infrared (IR) and visible (VIS) images is presented in this paper. System UFO is principally suited for mobile applications. Of course, it can be also used on fixed platforms as well. Therefore, much effort has been spent to ensure appropriate low power consumption and robustness against harsh environments. Overview and discussion of the hardware structure of the UFO system is presented. Principally, the system was build around single, low power FPGA core. The proposed structure of the hardware is very clear and compact. Mixed solutions, based on applications of multiple FPGA and DSP processors, after discussion, have been rejected in spite of insufficient computational power. Some substantial reasons for this have been presented in this paper. Chosen image registering and fusion procedures have been implemented to proof technical quality of the system. Achieved experimental results certified the ability of the presented system for real-time applications.