Augmented reality in operating microscopes for neurosurgical interventions

Currently, there are no commercial systems available which provide the surgeon with a real three dimensional, stereoscopic overlay of the operating field in an operating microscope. We introduce a concept for a stereoscopic overlay of the operating field using the optics of the operating microscope. Preoperatively achieved data are inserted into the optics of the operating microscope. The goal is to enhance the surgeon's ability for a better intraoperative orientation by giving him the three-dimensional information he needs. To achieve this we developed a concept using virtual cameras for the collimation. We also analyzed current display technologies to determine the best technology which meets our demands. Another advantage of this approach is to prevent the surgeon from the need to take his view from the operating field towards the screen of the navigation system and back. We propose a general process model, a prototype for injecting images into the operating microscope and a visualization concept. In the frame of this work a brain phantom used as trial object for our prototype is developed. The work is supported by the Deutsche Forschungsgemeinschaft (DFG), as a part of the Priority Programme 1124: "Medical Navigation and Robotics".