Single Object Tracking in Satellite Videos Through Deep Learning and Motion Detection Techniques

Single object tracking in satellite videos has recently gained a lot of attention in the field of computer vision. Although the satellite images are very informative, the small size of the objects and limited spatial and temporal resolution might make object tracking difficult and inaccurate. In this paper, we propose a method for accurately tracking small objects in satellite videos. In the initial phase, we applied the Fast Super-Resolution Convolutional Neural Network (FSRCNN), a deep learning-based super-resolution technique, to enhance the resolution of the frames. This procedure serves to sharpen the details and features of the objects, resulting in a clearer representation. The main contribution, however, lies in our incorporation of a robust motion detection technique into our framework, marking a significant step forward in this study. The motion detection approach combines various methods and operations with the primary goal of making moving objects distinctly visible and easily distinguishable from the complex image background. This enhancement significantly contributes to the precision and accuracy of the tracking system. We combined both approaches with Fully Convolutional Siamese Network (SiamFC) due to its robustness in tracking processes across frames in videos, capacity to handle changes in target appearance, and ability to deal with small datasets. The Satellite Video Single Object Tracking (SatSOT) and SV248A10-SOT (SV248S), two satellite video single object tracking datasets, were used to evaluate the proposed approach. When the techniques were applied, the SatSOT dataset showed an 11% precision score increase and a 10% success rate improvement. The SV248S dataset exhibited even more significant improvements, with precision scores increasing by 18% and success scores rising by 9%.