Consistent Wce Video Frame Interpolation Based On Endoscopy Image Motion Estimation

The development of wireless capsule endoscopy (WCE) allows painless imaging of the internal digestive environment. Limited by the image acquisition and transmitting time, the frame rate of WCE device is not high enough to generate visually consistent video data. Therefore, in the present contribution, we propose a robust WCE video frame interpolation method, aiming at generating consistent and detail-rich gastrointestinal (GI) track video frames. Considering the special environment of digestive system, we firstly correct the WCE device image capturing position based on stereo geometry to align adjacent frames, and then estimate optical flow using PWC-Net flow estimation architecture. Using the well refined optical flow, intermediate frame between two adjacent frames is interpolated and projected back to the original WCE image form. Comparing with a state-of-the-art method DAIN, our work outperforms on both visual performance and frame prediction accuracy. This work significantly improves the smoothness of WCE video, and provides more completed image data for subsequent data processing.