Scheduled System Maintenance:
On May 6th, system maintenance will take place from 8:00 AM - 12:00 PM ET (12:00 - 16:00 UTC). During this time, there may be intermittent impact on performance. We apologize for the inconvenience.
By Topic

Incremental learning in dynamic environments using neural network with long-term memory

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

The purchase and pricing options are temporarily unavailable. Please try again later.
2 Author(s)
Tsumori, K. ; Graduate Sch. of Sci. & Technol., Kobe Univ., Japan ; Ozawa, S.

When the environment is dynamically changed for agents, knowledge acquired from an environment might be useless in the future environments. Therefore, agents should not only acquire new knowledge but also modify or delete old knowledge. However, these modification and deletion are not always efficient in learning. Because the knowledge once acquired in the past can be useful again in the future when the same environment reappears. To learn efficiently in this situation, agents should have memory to store old knowledge. In this paper, we propose an agent architecture that consists of four modules: resource allocating network (PAN), long-term memory (LTM), association buffer (A-Buffer), and environmental change detector (ECD). In LTM, not only acquired knowledge but also the information about which knowledge was produced in the same environment is stored. This information is utilized for recalling the knowledge acquired in the past when the same environment reappears. To evaluate the adaptability in a class of dynamic environments, we apply this model to a simple problem that some target functions to be approximated are changed in turn. As a result, we verify the following adaptability of RAN-ALTM: (1) incremental learning can be stably carried out, (2) environmental changes are correctly detected, (3) fast adaptation is realized by training some of the accumulated knowledge when the past environments reappear.

Published in:

Neural Networks, 2003. Proceedings of the International Joint Conference on  (Volume:4 )

Date of Conference:

20-24 July 2003