Virtual Companion Based Mobile User Interface: An Intelligent and Simplified Mobile User Interface for the Elderly Users

In this work, we proposed a virtual companion based interface that simplifies the smartphone interface for the elderly. This interface displays menus according to the situation and users' request via a virtual agent and animates information in a 3-dimensional manner. We applied speech recognition technology from mobile and wearable devices to receive input from users. Virtual avatars were selected to visualize appropriate behavior based on user input. We expect that this mobile interface could be a future of next smartphone user interface.