Projector Illuminated Precise Stencils on Surgical Sites

We propose a system that provides realtime guidance to surgeons by illuminating salient markings on the physical surgical site using a projector. In addition to the projector, the system uses a RGB-D camera for feedback. This unit is called the projector-depth-camera or PDC unit. Using the PDC, we perform structured light scanning and generate a high resolution mesh of the surgical site. During planning or execution of the surgery, this digital model is marked by appropriate incision markings through a GUI. These markings are then illuminated at high precision via the PDC unit on the surgical site in realtime. If the surgical site moves during the process, the movement is tracked by the system and updated quickly on the moved surgical site.