By Topic

Online learning of concepts and words using multimodal LDA and hierarchical Pitman-Yor Language Model

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

The purchase and pricing options are temporarily unavailable. Please try again later.
6 Author(s)
Araki, T. ; Dept. of Mech. Eng. & Intell. Syst., Univ. of Electro-Commun., Chofu, Japan ; Nakamura, T. ; Nagai, T. ; Nagasaka, S.
more authors

In this paper, we propose an online algorithm for multimodal categorization based on the autonomously acquired multimodal information and partial words given by human users. For multimodal concept formation, multimodal latent Dirichlet allocation (MLDA) using Gibbs sampling is extended to an online version. We introduce a particle filter, which significantly improve the performance of the online MLDA, to keep tracking good models among various models with different parameters. We also introduce an unsupervised word segmentation method based on hierarchical Pitman-Yor Language Model (HPYLM). Since the HPYLM requires no predefined lexicon, we can make the robot system that learns concepts and words in completely unsupervised manner. The proposed algorithms are implemented on a real robot and tested using real everyday objects to show the validity of the proposed system.

Published in:

Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on

Date of Conference:

7-12 Oct. 2012