Applying Learning by Tutelage and Multimodal Interface to Sociable Robots

In this article, a learning mechanism and a multimodal interface are presented. The learning mechanism allows the robot to learn concepts of the environment by human tutelage. The multimodal interface employs mechanisms of face detection, pose estimation, object saliency and speech recognition. The learning mechanism and multimodal interface are evaluated in the context of concept learning.