Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures

During the past three years, we've tried to develop integrated AR solutions in the context of minimally invasive surgery. We have therefore focused on four main issues: recovery and monitoring of surgical workflow, integrating preoperative and intraoperative anatomic and functional data, improving visual perception in a mixed environment, and developing new user interaction paradigms for taking full advantage of the virtual data, while overlaid onto the real scene. Each of these issues is the subject of many existing and future publications. Here, we provide a brief overview of our activities and current results in regard to each of these issues.