By Topic

Noisy recurrent neural networks: the continuous-time case

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
S. Das ; Dept. of Electr. & Comput. Eng., George Mason Univ., Fairfax, VA, USA ; O. Olurotimi

The classical stochastic analog of the deterministic linear system in engineering is the linear system driven by white noise. As the promise of artificial neural networks in modeling nonlinear systems continues to grow, the need for a stochastic analog with quantitative foundations for analysis and synthesis will increase. This paper presents recent work in this direction, examining recurrent neural nets (RNN driven by white noise. We examine the effect of noise on the typical continuous-time RNN model. First, we perform qualitative analysis establishing uniform boundedness of moments of the neuron states over time. To enable practical application, however, it is necessary to relate these properties to useful measures that can be estimated. We thus subsequently derive bias and variance measures for the noisy RNN with respect to the corresponding deterministic RNN. This has significant practical implications, since net design is nonminimal in the sense that several nets can solve the same problem. The results allow the user to evaluate given RNN for noise performance. The designer can use these results to constrain the design space so that the design satisfies performance specifications whenever possible. An example is provided using the measures derived in this paper to predetermine the best among several RNN designs for a given problem

Published in:

IEEE Transactions on Neural Networks  (Volume:9 ,  Issue: 5 )