Ultrasound Tracking Using ProbeSight: Camera Pose Estimation Relative to External Anatomy by Inverse Rendering of a Prior High-Resolution 3D Surface Map

This paper addresses the problem offreehand ultrasound probe tracking without requiring an external tracking device, by mounting a video camera on the probe to identify location relative to the patient's external anatomy. By pre-acquiring a high-resolution 3D surface map as an atlas ofthe anatomy, we eliminate the needfor artificial skin markers. We use an OpenDR pipeline for inverse rendering and pose estimation via matching the real-time camera image with the 3D surface map. We have addressed the problem ofdistinguishing rotation from translation by including an inertial navigation system to accurately measure rotation. Experiments on both a phantom containing an image ofhuman skin (palm) as well as actual human skin (fingers, palm, and wrist) validate the effectiveness ofour approach. For ultrasound, this will permit the compilation of3D ultrasound data as the probe is moved, as well as comparison ofreal-time ultrasound scans registered with previous scans from the same anatomical location. In a broader sense, tools that know where they are by looking at the patient's exterior could have broad beneficial impact on clinical medicine.