Abstract:
Prognostic health management (PHM) has become important in many industries as a critical technology to increase machine stability and operational efficiency. Recently, va...Show MoreMetadata
Abstract:
Prognostic health management (PHM) has become important in many industries as a critical technology to increase machine stability and operational efficiency. Recently, various methods using deep learning to estimate the remaining useful life (RUL) as a core task of PHM have been proposed. However, the existing attention methods do not explicitly capture the correlation between temporal and spatial time series, reducing the RUL prediction accuracy. This article proposes a novel RUL prediction algorithm using a spatiotemporal attention mechanism based on the pseudo-label vectors to solve this problem. The proposed attention network uses the pseudo-label vector learned in the intermediate prediction process as a query vector to focus on time sequence data related to the RUL. Therefore, compared with conventional attention models that extract correlations for all the sequences, the proposed model captures features directly related to RUL with less computational cost. Experiments have been performed on two widely used datasets, and the experimental results show that the proposed approach outperforms the state of the art for root-mean-square error, with averages 4.27 and 3039 in the NASA Commercial Modular Aero-Propulsion System Simulation dataset and the IEEE PHM 2012 Prognostic challenge dataset, respectively. In addition, the analysis in the experiment reveals that the proposed model has better interpretability than the existing models by obtaining the correlation between time-series data and the RUL through the attention score in terms of time and features.
Published in: IEEE Transactions on Industrial Informatics ( Volume: 19, Issue: 4, April 2023)
Funding Agency:

Department of Electronic Engineering, Sogang University, Seoul, South Korea
Ye-In Park received the B.S. degree in computer science from Dongduk Women's University, Seoul, South Korea, in 2018. She is currently working toward the Ph.D. degree in electronic engineering with Sogang University, Seoul.
Her current research interests include image restoration, deep learning, computer vision, and mining in time-series data.
Ye-In Park received the B.S. degree in computer science from Dongduk Women's University, Seoul, South Korea, in 2018. She is currently working toward the Ph.D. degree in electronic engineering with Sogang University, Seoul.
Her current research interests include image restoration, deep learning, computer vision, and mining in time-series data.View more

LG Electronics, Seoul, South Korea
Jou Won Song received the B.S. and M.S. degrees in electronic engineering from Sogang University, Seoul, South Korea, in 2020 and 2022, respectively.
He is currently a Researcher with LG Electronics, Seoul. His current research interests include anomaly detection, deep learning, image restoration, and computer vision.
Jou Won Song received the B.S. and M.S. degrees in electronic engineering from Sogang University, Seoul, South Korea, in 2020 and 2022, respectively.
He is currently a Researcher with LG Electronics, Seoul. His current research interests include anomaly detection, deep learning, image restoration, and computer vision.View more

Department of Electronic Engineering, Sogang University, Seoul, South Korea
Suk-Ju Kang (Member, IEEE) received the B.S. degree in electronic engineering from Sogang University, Seoul, South Korea, in 2006, and the Ph.D. degree in electrical and computer engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2011.
From 2011 to 2012, he was a Senior Researcher with LG Display Co., Ltd., Seoul, where he was a Project Leader for resolution enhancement and multiview ...Show More
Suk-Ju Kang (Member, IEEE) received the B.S. degree in electronic engineering from Sogang University, Seoul, South Korea, in 2006, and the Ph.D. degree in electrical and computer engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2011.
From 2011 to 2012, he was a Senior Researcher with LG Display Co., Ltd., Seoul, where he was a Project Leader for resolution enhancement and multiview ...View more

Department of Electronic Engineering, Sogang University, Seoul, South Korea
Ye-In Park received the B.S. degree in computer science from Dongduk Women's University, Seoul, South Korea, in 2018. She is currently working toward the Ph.D. degree in electronic engineering with Sogang University, Seoul.
Her current research interests include image restoration, deep learning, computer vision, and mining in time-series data.
Ye-In Park received the B.S. degree in computer science from Dongduk Women's University, Seoul, South Korea, in 2018. She is currently working toward the Ph.D. degree in electronic engineering with Sogang University, Seoul.
Her current research interests include image restoration, deep learning, computer vision, and mining in time-series data.View more

LG Electronics, Seoul, South Korea
Jou Won Song received the B.S. and M.S. degrees in electronic engineering from Sogang University, Seoul, South Korea, in 2020 and 2022, respectively.
He is currently a Researcher with LG Electronics, Seoul. His current research interests include anomaly detection, deep learning, image restoration, and computer vision.
Jou Won Song received the B.S. and M.S. degrees in electronic engineering from Sogang University, Seoul, South Korea, in 2020 and 2022, respectively.
He is currently a Researcher with LG Electronics, Seoul. His current research interests include anomaly detection, deep learning, image restoration, and computer vision.View more

Department of Electronic Engineering, Sogang University, Seoul, South Korea
Suk-Ju Kang (Member, IEEE) received the B.S. degree in electronic engineering from Sogang University, Seoul, South Korea, in 2006, and the Ph.D. degree in electrical and computer engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2011.
From 2011 to 2012, he was a Senior Researcher with LG Display Co., Ltd., Seoul, where he was a Project Leader for resolution enhancement and multiview 3-D system projects. From 2012 to 2015, he was an Assistant Professor of Electrical Engineering with Dong-A University, Busan, South Korea. He is currently a Professor of Electronic Engineering with Sogang University, Seoul. His current research interests include image analysis and enhancement, video processing, multimedia signal processing, digital system design, and deep learning systems.
Dr. Kang was a recipient of the IEIE/IEEE Joint Award for Young IT Engineer of the Year in 2019 and the Merck Young Scientist Award in 2022.
Suk-Ju Kang (Member, IEEE) received the B.S. degree in electronic engineering from Sogang University, Seoul, South Korea, in 2006, and the Ph.D. degree in electrical and computer engineering from the Pohang University of Science and Technology, Pohang, South Korea, in 2011.
From 2011 to 2012, he was a Senior Researcher with LG Display Co., Ltd., Seoul, where he was a Project Leader for resolution enhancement and multiview 3-D system projects. From 2012 to 2015, he was an Assistant Professor of Electrical Engineering with Dong-A University, Busan, South Korea. He is currently a Professor of Electronic Engineering with Sogang University, Seoul. His current research interests include image analysis and enhancement, video processing, multimedia signal processing, digital system design, and deep learning systems.
Dr. Kang was a recipient of the IEIE/IEEE Joint Award for Young IT Engineer of the Year in 2019 and the Merck Young Scientist Award in 2022.View more