Unified Object Detection Model for Image Style Convertible Modalities

Object detection is an important task in computer vision. In earlier studies, object detection mostly works on single-modal. But recently, in order to improve detection efficiency, researchers start adding more modals for improving the robustness of detection result. In this paper, we assume that all input modals which can convert to image style are able to complete object detection task through a unified model. We choose YOLOv7 as our baseline model and use RGB and infrared images from the public dataset Camel to test our hypothesis. Based on our experiment results, training RGB and IR images together obtains better performance than training individually, which shows that all image style modalities are possibly handled by a unified model and even achieve better results.