Augmented reality user interface for an atomic force microscope-based nanorobotic system

A real-time augmented reality (AR) user interface for nanoscale interaction and manipulation applications using an atomic force microscope (AFM) is presented. Nanoscale three-dimensional (3-D) topography and force information sensed by an AFM probe are fed back to a user through a simulated AR system. The sample surface is modeled with a B-spline-based geometry model, upon which a collision detection algorithm determines whether and how the spherical AFM tip penetrates the surface. Based on these results, the induced surface deformations are simulated using continuum micro/nanoforce and Maugis-Dugdale elastic contact mechanics models, and 3-D decoupled force feedback information is obtained in real time. The simulated information is then blended in real time with the force measurements of the AFM in an AR human machine interface, comprising a computer graphics environment and a haptic interface. Accuracy, usability, and reliability of the proposed AR user interface is tested by experiments for three tasks: positioning the AFM probe tip close to a surface, just in contact with a surface, or below a surface by elastically indenting. Results of these tests showed the performance of the proposed user interface. This user interface would be critical for many nanorobotic applications in biotechnology, nanodevice prototyping, and nanotechnology education.