By Topic

Using an effective Boltzmann machine to learn context dependencies of a sequence

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
M. I. Bellgard ; Dept. of Comput. Sci., Murdoch Univ., WA, Australia ; Chi-Ping Tsang

It has been recognised that current artificial neural network (ANN) systems that employ windowing techniques to learn context dependencies in sequences have many deficiencies. One variant of this type of system that attempts to overcome many of these deficiencies is the effective Boltzmann machine (EBM). The EBM which is based on the Boltzmann machine (BM) has the ability to perform completion and to provide an energy measure for the solution. In this paper, the authors extend the EBM and show that the system has many desirable properties. This paper reports two major improvements to the EBM. First, where as in the past, a BM is used to learn the local contexts of a sequence, yhe authors show that the EBM itself is an architecture suitable for learning local contexts. The authors' initial experiments show that it outperforms a window based BM. Second, the authors demonstrate that, with this new training scheme, a multilayer EBM can be constructed to extend the effective window size. This means that learning contextual dependencies is not limited by the window size. This is done by utilising the state information of the first EBM hidden layer to train that of the second EBM layer. The effect of this long range effective window is demonstrated by experiments

Published in:

Neural Networks, 1995. Proceedings., IEEE International Conference on  (Volume:5 )

Date of Conference:

Nov/Dec 1995