VibNet: Vibration-Boosted Needle Detection in Ultrasound Images

Precise percutaneous needle detection is crucial for ultrasound (US)-guided interventions. However, inherent limitations such as speckles, needle-like artifacts, and low resolution make it challenging to robustly detect needles, especially when their visibility is reduced or imperceptible. To address this challenge, we propose VibNet, a learning-based framework designed to enhance the robustness and accuracy of needle detection in US images by leveraging periodic vibration applied externally to the needle shafts. VibNet integrates neural Short-Time Fourier Transform and Hough Transform modules to achieve successive sub-goals, including motion feature extraction in the spatiotemporal space, frequency feature aggregation, and needle detection in the Hough space. Due to the periodic subtle vibration, the features are more robust in the frequency domain than in the image intensity domain, making VibNet more effective than traditional intensity-based methods. To demonstrate the effectiveness of VibNet, we conducted experiments on distinct ex vivo porcine and bovine tissue samples. The results obtained on porcine samples demonstrate that VibNet effectively detects needles even when their visibility is severely reduced, with a tip error of ${1}.{61}\pm {1}.{56}~\textit {mm}$ compared to ${8}.{15}\pm {9}.{98}~\textit {mm}$ for UNet and ${6}.{63}\pm {7}.{58}~\textit {mm}$ for WNet, and a needle direction error of ${1}.{64}\pm {1}.{86}^{\circ }$ compared to ${9}.{29}~\pm ~{15}.{30}^{\circ }$ for UNet and ${8}.{54}~\pm ~{17}.{92}^{\circ }$ for WNet. Code: https://github.com/marslicy/VibNet.