A multiple robot cognitive sharing system using audio and video sensor

Recently, cooperation between robots attract attention as a method to realize advanced task that cannot be realized with single robot. However, in previous cooperation between robots, information to share is usually restricted to single modality. Therefore, we suggest a method of sharing various types of information to realize cooperation between multi-modality. With this method, peculiar information that cannot share are changed into the abstract hierarchy that the different type modality robot is able to share such as numerical value and the name label. In this paper, we assumed a garbage collection task as an example of cooperative tasks and design a system that integrates a vision based system with a sound based system. This integrated system execute a task by visual information to find a task by audiory information. We demonstrated availability of proposed method and visual-audio system by experimental result.