Natural interaction on 3D medical image viewer software

A common interaction with medical 2D and 3D images is to apply windows, icons, menus and pointers (WIMP) paradigm; however, WIMP might not be convenient in some situation, such as in the operating room where sterilization becomes an issue. Thus, in this project, the controller-free natural interaction on 3D medical image viewer software through a Kinect camera will be developed to replace WIMP such that surgeons can view medical images in the operating room without contacting mouse and keyboard. The interaction will include both body and figure gestures. The 3D medical image viewer software will be based on the Visualization ToolKit (VTK) library to visualize 3D image data in the DICOM (Digital Imaging and Communications in Medicine) format. Moreover, suitable controller patterns will be designed according to practical use in the operating room.