A Visual Language for Programming Reality-Based Interaction

Reality-based interfaces (RBIs) offer the promise of natural interfaces that are intuitive to use. By allowing users to leverage their innate skills and knowledge about the real-physical world, RBIs could benefit disadvantage populations that rely on physical I/O modalities and tangible representations. We present our research which is aimed at simplifying the development of RBIs by providing a technology-independent visual language for modeling and programming these interfaces. Such a language will enable developers to systematically analyze and compare interaction designs as part of the development process while addressing issues such as users' skills and needs. Ultimately, we expect this research to lower the barriers for developing RBIs