IEEE Transactions on Neural Networks and Learning Systems

In this paper, the problem of dissipativity analysis is discussed for discrete-time stochastic neural networks with time-varying discrete and finite-distributed delays. The discretized Jensen inequality and lower bounds lemma are adopted to deal with the involved finite sum quadratic terms, and a sufficient condition is derived to ensure the considered neural networks to be globally asymptotically... View full abstract»

New optimization models and algorithms for online learning with Kernels (OLK) in classification, regression, and novelty detection are proposed in a reproducing Kernel Hilbert space. Unlike the stochastic gradient descent algorithm, called the naive online Reg minimization algorithm (NORMA), OLK algorithms are obtained by solving a constrained optimization problem based on the proposed models. By ... View full abstract»

Most of the available control schemes for pure-feedback systems are derived based on the backstepping technique. On the contrary, this paper presents a novel adaptive control design for nonlinear pure-feedback systems without using backstepping. By introducing a set of alternative state variables and the corresponding transform, state-feedback control of the pure-feedback system can be viewed as o... View full abstract»

In this paper, we propose a nonconvex framework to learn the essential low-rank structure from corrupted data. Different from traditional approaches, which directly utilizes convex norms to measure the sparseness, our method introduces more reasonable nonconvex measurements to enhance the sparsity in both the intrinsic low-rank structure and the sparse corruptions. We will, respectively, introduce... View full abstract»

Variable behavior has been observed in several mechanisms found in biological neurons, resulting in changes in neural behavior that might be useful to capture in neuromorphic circuits. This paper presents a neuromorphic cortical neuron with synaptic neurotransmitter-release variability, which is designed to be used in neural networks as part of the Biomimetic Real-Time Cortex project. This neuron ... View full abstract»

This paper studies the problem of sampled-data control for master-slave synchronization schemes that consist of identical chaotic Lur'e systems with time delays. It is assumed that the sampling periods are arbitrarily varying but bounded. In order to take full advantage of the available information about the actual sampling pattern, a novel Lyapunov functional is proposed, which is positive defini... View full abstract»

The state-of-the-art classification methods which employ nonnegative matrix factorization (NMF) employ two consecutive independent steps. The first one performs data transformation (dimensionality reduction) and the second one classifies the transformed data using classification methods, such as nearest neighbor/centroid or support vector machines (SVMs). In the following, we focus on using NMF fa... View full abstract»

In this paper, we study the distributed synchronization and pinning distributed synchronization of stochastic coupled neural networks via randomly occurring control. Two Bernoulli stochastic variables are used to describe the occurrences of distributed adaptive control and updating law according to certain probabilities. Both distributed adaptive control and updating law for each vertex in a netwo... View full abstract»

In this paper, we consider using profit/loss histories of multiple automated trading systems (ATSs) as N input variables in portfolio management. By means of multivariate statistical analysis and simulation studies, we analyze the influences of sample size (L) and input dimensionality on the accuracy of determining the portfolio weights. We find that degradation in portfolio performance due to ine... View full abstract»

In this paper, we propose a method for P-variate probability density estimation assuming a Gaussian mixture model (GMM). Our method exploits a regularization technique for improving the estimation accuracy of the GMM component covariance matrices. We derive an expectation maximization algorithm for fitting our regularized GMM (RGMM), which exploits an analytical Ledoit-Wolf-type shrinkage estimati... View full abstract»

The stochastic optimal controller design for the nonlinear networked control system (NNCS) with uncertain system dynamics is a challenging problem due to the presence of both system nonlinearities and communication network imperfections, such as random delays and packet losses, which are not unknown a priori. In the recent literature, neuro dynamic programming (NDP) techniques, based on value and ... View full abstract»

Principal component analysis (PCA) is a widely used model for dimensionality reduction. In this paper, we address the problem of determining the intrinsic dimensionality of a general type data population by selecting the number of principal components for a generalized PCA model. In particular, we propose a generalized Bayesian PCA model, which deals with general type data by employing exponential... View full abstract»

Information processing in the nervous system involves the activity of large populations of neurons. It is difficult to extract information from these population codes because of the noise inherent in neuronal responses. We propose a divisive normalization model to read the population codes. The dynamics of the model are analyzed by continuous attractor theory. Under certain conditions, the model p... View full abstract»

This brief presents an analysis of the performance of kernel smoothing models used to estimate an unknown target function, addressing the case where the choice of the training set is part of the learning process. In particular, we consider a choice of the points at which the function is observed based on low-discrepancy sequences, which is a family of sampling methods commonly employed for efficie... View full abstract»