Intelligent Vision Systems – Bringing Human-Machine Interface to AR/VR

AR/VR devices are believed to be the next generation mobile compute platform that will replace today’s smart-phones. These devices will require new human-machine input (HMI) modalities that are intuitive, non-interruptive, and socially friendly and responsive in an all-day wearable glasses form factor. The candidate HMI modalities include voice, eye gazing, hand/head/body gestsures, and brain-computer interface (BCI). This paper describes computer vision based modalities along with the sensor and system specifications. It also proposes solutions to the extremely stringent power, form factor and performance challenges.