Multi-Frame Blind Restoration for Image of Space Target With FRC and Branch-Attention

The random noise and anisotropic motion of atmospheric turbulence can cause different degradation patterns, which make images of space targets observed from ground-based stations severely disturbed. In recent years, benefit from the development of convolutional neural networks (CNNs), a large number of effective end-to-end methods were proposed to restore images. However, a single-frame method whose input is just a single image can hardly achieve a further improvement for the restoration image due to the diversified degradation patterns of space-target images. In this paper, we proposed a multi-branch network with a multi-frame input to restore space-target images. The multi-frame input contains space-target images which own different degradation patterns at different moments. In this way, we can fully use the complementary information between input frames. And in this network, two effective technologies are introduced: one is the full resolution convolution module which extracts features by using convolutional layers with different dilation rates to keep feature information complete; the other is the branch-attention module which is used to pass effective information between different branches of the network. Furthermore, we demonstrated the effectiveness of our method by comparing it with those state-of-the-art methods.