Intelligent pointer in computer assisted surgery-design and feasibility

We present a solution combining the newest technologies in computer vision and preoperativeiy planned surgical intervention to enhanced the efficiency of complex surgery. There have been many solutions proposed to use computer vision in the operating room, but they often depend on annoying and expensive components such as head mounted display (HMD). These systems have proven to be of weak precision and, due to their weight and size, they tend to be really disturbing if worn during long period of time. The goal of this work is to demonstrate the possibility of a system projecting directly on the patient, in real time, during the surgery. The main advantage is to keep the attention of the surgeon focused directly on his patient at all times. The information that can be added to the scene, due to the absence of HMD is evidently restricted to 2D since only one image is projected on the patient (skin, bone, surgery linen etc.) instead of two images for the right and left eyes with HMD, but by using an intelligent pointer to highlight important zones in the line of sight of the surgeon, 3D information can be inferred. This system actually transforms the patient body itself into a visual data source for the surgeon.