This figure shows that the backpropagation error can be newly explained in terms of weight deviation. A novel adaptive learning-rate backpropagation algorithm based on th...
Abstract:
This paper presents a novel adaptive learning-rate backpropagation neural network (ALR-BPNN) algorithm based on the minimization of mean-square deviation (MSD) to impleme...Show MoreMetadata
Abstract:
This paper presents a novel adaptive learning-rate backpropagation neural network (ALR-BPNN) algorithm based on the minimization of mean-square deviation (MSD) to implement a fast convergence rate and robustness to impulsive noises. The learning rates of the weights in each hidden layer are derived to minimize the upper bound of the MSD obtained by the analysis, which guarantees a fast convergence rate in a stable range. Moreover, by adopting the variance of the kind of the measurement noises in each layer through the variance of the error signals, the proposed scheme provides robustness to the impulsive noises. The performance of the proposed algorithm is evaluated on various sequential signals and industrial data including the impulsive noise and compared with conventional ALR-BPNN algorithms. Simulation results indicate that the proposed algorithm outperforms the existing algorithms.
This figure shows that the backpropagation error can be newly explained in terms of weight deviation. A novel adaptive learning-rate backpropagation algorithm based on th...
Published in: IEEE Access ( Volume: 8)
Funding Agency:
Department of Electronic and Electrical Engineering, Pohang University of Science and Technology, Pohang, South Korea
Dong Woo Kim (Student Member, IEEE) received the B.S. and M.S. degrees in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2014 and 2016, respectively, where he is currently pursuing the Ph.D. degree in electronic and electrical engineering. His research interests include adaptive filtering algorithm and active noise control systems.
Dong Woo Kim (Student Member, IEEE) received the B.S. and M.S. degrees in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2014 and 2016, respectively, where he is currently pursuing the Ph.D. degree in electronic and electrical engineering. His research interests include adaptive filtering algorithm and active noise control systems.View more
Department of Electronic and Electrical Engineering, Pohang University of Science and Technology, Pohang, South Korea
Min Su Kim (Graduate Student Member, IEEE) received the B.S. and M.S. degrees in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2014 and 2016, respectively, where he is currently pursuing the Ph.D. degree in electronic and electrical engineering. His research interests include deep learning based modeling and state estimation.
Min Su Kim (Graduate Student Member, IEEE) received the B.S. and M.S. degrees in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2014 and 2016, respectively, where he is currently pursuing the Ph.D. degree in electronic and electrical engineering. His research interests include deep learning based modeling and state estimation.View more
AI Laboratory, LG Electronics Inc., Seoul, South Korea
Jaeho Lee received the B.S. degree in electronic and electrical engineering from Sungkyunkwan University, Suwon, South Korea, in 2017, and the M.S. degree in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2019. He is currently an Associate Researcher with the AI Laboratory, LG Electronics Inc., Seoul, implementing on-device intelligence on various home a...Show More
Jaeho Lee received the B.S. degree in electronic and electrical engineering from Sungkyunkwan University, Suwon, South Korea, in 2017, and the M.S. degree in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2019. He is currently an Associate Researcher with the AI Laboratory, LG Electronics Inc., Seoul, implementing on-device intelligence on various home a...View more
Department of Electronic and Electrical Engineering, Pohang University of Science and Technology, Pohang, South Korea
Poogyeon Park (Senior Member, IEEE) received the B.S. and M.S. degrees in control and instrumentation engineering from Seoul National University, Seoul, South Korea, in 1988 and 1990, respectively, and the Ph.D. degree from Stanford University, Stanford, CA, USA, in 1995.
From 1996 to 2000, he was an Assistant Professor with the Pohang University of Science and Technology. Since 2006, he has been a Professor with the Elect...Show More
Poogyeon Park (Senior Member, IEEE) received the B.S. and M.S. degrees in control and instrumentation engineering from Seoul National University, Seoul, South Korea, in 1988 and 1990, respectively, and the Ph.D. degree from Stanford University, Stanford, CA, USA, in 1995.
From 1996 to 2000, he was an Assistant Professor with the Pohang University of Science and Technology. Since 2006, he has been a Professor with the Elect...View more
Contents Department of Electronic and Electrical Engineering, Pohang University of Science and Technology, Pohang, South Korea
Dong Woo Kim (Student Member, IEEE) received the B.S. and M.S. degrees in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2014 and 2016, respectively, where he is currently pursuing the Ph.D. degree in electronic and electrical engineering. His research interests include adaptive filtering algorithm and active noise control systems.
Dong Woo Kim (Student Member, IEEE) received the B.S. and M.S. degrees in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2014 and 2016, respectively, where he is currently pursuing the Ph.D. degree in electronic and electrical engineering. His research interests include adaptive filtering algorithm and active noise control systems.View more
Department of Electronic and Electrical Engineering, Pohang University of Science and Technology, Pohang, South Korea
Min Su Kim (Graduate Student Member, IEEE) received the B.S. and M.S. degrees in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2014 and 2016, respectively, where he is currently pursuing the Ph.D. degree in electronic and electrical engineering. His research interests include deep learning based modeling and state estimation.
Min Su Kim (Graduate Student Member, IEEE) received the B.S. and M.S. degrees in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2014 and 2016, respectively, where he is currently pursuing the Ph.D. degree in electronic and electrical engineering. His research interests include deep learning based modeling and state estimation.View more
AI Laboratory, LG Electronics Inc., Seoul, South Korea
Jaeho Lee received the B.S. degree in electronic and electrical engineering from Sungkyunkwan University, Suwon, South Korea, in 2017, and the M.S. degree in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2019. He is currently an Associate Researcher with the AI Laboratory, LG Electronics Inc., Seoul, implementing on-device intelligence on various home appliances. His research interests include reinforcement learning, time-series prediction, and neural network optimization.
Jaeho Lee received the B.S. degree in electronic and electrical engineering from Sungkyunkwan University, Suwon, South Korea, in 2017, and the M.S. degree in electronic and electrical engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2019. He is currently an Associate Researcher with the AI Laboratory, LG Electronics Inc., Seoul, implementing on-device intelligence on various home appliances. His research interests include reinforcement learning, time-series prediction, and neural network optimization.View more
Department of Electronic and Electrical Engineering, Pohang University of Science and Technology, Pohang, South Korea
Poogyeon Park (Senior Member, IEEE) received the B.S. and M.S. degrees in control and instrumentation engineering from Seoul National University, Seoul, South Korea, in 1988 and 1990, respectively, and the Ph.D. degree from Stanford University, Stanford, CA, USA, in 1995.
From 1996 to 2000, he was an Assistant Professor with the Pohang University of Science and Technology. Since 2006, he has been a Professor with the Electronic Electrical Engineering Department, Pohang University of Science and Technology. He has authored over 170 articles and the total citation for his articles is 9712. His research interest includes control and signal processing.
Poogyeon Park (Senior Member, IEEE) received the B.S. and M.S. degrees in control and instrumentation engineering from Seoul National University, Seoul, South Korea, in 1988 and 1990, respectively, and the Ph.D. degree from Stanford University, Stanford, CA, USA, in 1995.
From 1996 to 2000, he was an Assistant Professor with the Pohang University of Science and Technology. Since 2006, he has been a Professor with the Electronic Electrical Engineering Department, Pohang University of Science and Technology. He has authored over 170 articles and the total citation for his articles is 9712. His research interest includes control and signal processing.View more