By Topic

Incremental learning with sleep

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

1 Author(s)
Yamauchi, K. ; Graduate Sch. of Eng., Hokkaido Univ., Sapporo, Japan

Incremental learning methods usually face the problem of forgetting. To avoid the problem, the system usually needs to re-learn old instances again. During the learning phase, we cannot make the system recognize new inputs. In contrast, k-nearest neighbors (k-NN) memorize new instances only by appending the new instances to its database so that k-NN does not waste learning time. However, k-NN wastes a large amount of resources to record all instances. To solve the problem, the author presents several model-based incremental learning systems for function approximation. Those methods reduce apparent learning time by introducing a sleep phase. Therefore, during the awake phase, the system can recognize known instances and memorize unknown new instances simultaneously. On the other hand, during sleep phase, the system realizes model-selection for reduction of redundant hidden units. This paper presents an extended version of the previous method to improve its generalization ability in addition to applying it to various classification problem. Several benchmark tests show that the new system learns instances quickly, as does k-NN, but uses only about 10% to 50% of the resources of k-NN. The generalization ability also outperforms the k-NN.

Published in:

Neural Networks, 2003. Proceedings of the International Joint Conference on  (Volume:4 )

Date of Conference:

20-24 July 2003