Overview of the suggested method. A model is trained using non-anomalous training data and is then used to generate channel-wise residuals. When thresholds have been sele...
Abstract:
The importance of anomaly detection in multivariate time series has led to the development of several prominent deep learning solutions. As a part of the anomaly detectio...Show MoreMetadata
Abstract:
The importance of anomaly detection in multivariate time series has led to the development of several prominent deep learning solutions. As a part of the anomaly detection process, the scoring method has shown to be of significant importance when separating non-anomalous points from anomalous ones. At this time, most of the solutions utilize an aggregated score which means that relevant information created by the anomaly detection model might be lost. Therefore, this study has set out to examine to what extent anomaly detection in multivariate time series based on deep learning can be improved if all the residuals from each individual channel is considered in the anomaly score. To achieve this, an aggregated and separated scoring method has been applied with a simple denoising convolutional autoencoder. In addition, the performance has been compared with other state-of-the-art methods. The result showed that the separated approach has the potential to generate a significantly higher performance than the aggregated one. At the same time, there were some indications suggesting that an aggregated scoring is better at generalizing when no labels are available to select the anomaly thresholds. Therefore, the result should serve as an encouragement to use a separated scoring approach together with a small sample of labeled anomalies to optimize the thresholds. Lastly, due to the impact of the anomaly score, the result suggests that future research within this field should consider applying the same anomaly scoring method when comparing the performance of deep learning algorithms.
Overview of the suggested method. A model is trained using non-anomalous training data and is then used to generate channel-wise residuals. When thresholds have been sele...
Published in: IEEE Access ( Volume: 10)
Funding Agency:

Department of Electronics Design, Mid Sweden University, Sundsvall, Sweden
SCA, Sundsvall, Sweden
Adam Lundström received the M.S. degree in industrial engineering and management from Mid Sweden University and the M.S. degree in computer and systems sciences from Stockholm University, in 2020. He is currently pursuing the Ph.D. degree with the Industrial Graduate School Smart Industry Sweden and studying the potential for machine learning solutions in predictive maintenance. He is employed with SCA and a part of the D...Show More
Adam Lundström received the M.S. degree in industrial engineering and management from Mid Sweden University and the M.S. degree in computer and systems sciences from Stockholm University, in 2020. He is currently pursuing the Ph.D. degree with the Industrial Graduate School Smart Industry Sweden and studying the potential for machine learning solutions in predictive maintenance. He is employed with SCA and a part of the D...View more

Department of Electronics Design, Mid Sweden University, Sundsvall, Sweden
Mattias O’nils received the B.S. degree in electrical engineering from Mid Sweden University, Sundsvall, Sweden, in 1993, and the Licentiate and Ph.D. degrees in electronic systems design from the Royal Institute of Technology, Stockholm, Sweden, in 1996 and 1999, respectively. He is currently a Professor with the Department of Electronics Design and leads the Research Group in Embedded IoT Systems, Mid Sweden University....Show More
Mattias O’nils received the B.S. degree in electrical engineering from Mid Sweden University, Sundsvall, Sweden, in 1993, and the Licentiate and Ph.D. degrees in electronic systems design from the Royal Institute of Technology, Stockholm, Sweden, in 1996 and 1999, respectively. He is currently a Professor with the Department of Electronics Design and leads the Research Group in Embedded IoT Systems, Mid Sweden University....View more

Department of Electronics Design, Mid Sweden University, Sundsvall, Sweden
Faculty of Science, University of Ontario Institute of Technology, Oshawa, Canada
Faisal Z. Qureshi (Senior Member, IEEE) received the B.Sc. degree in mathematics and physics from Punjab University, Lahore, Pakistan, in 1993, the M.Sc. degree in electronics from Quaid-e-Azam University, Islamabad, Pakistan, in 1995, and the M.Sc. and Ph.D. degrees in computer science from the University of Toronto, Toronto, ON, Canada, in 2000 and 2007, respectively. He is currently a Professor of computer science with...Show More
Faisal Z. Qureshi (Senior Member, IEEE) received the B.Sc. degree in mathematics and physics from Punjab University, Lahore, Pakistan, in 1993, the M.Sc. degree in electronics from Quaid-e-Azam University, Islamabad, Pakistan, in 1995, and the M.Sc. and Ph.D. degrees in computer science from the University of Toronto, Toronto, ON, Canada, in 2000 and 2007, respectively. He is currently a Professor of computer science with...View more

Department of Electronics Design, Mid Sweden University, Sundsvall, Sweden
Institute of Computer Technology, TU Wien, Vienna, Austria
Axel Jantsch (Senior Member, IEEE) received the Dipl.Ing. and Ph.D. degrees in computer science from TU Wien, Vienna, Austria, in 1987 and 1992, respectively. From 1997 to 2002, he was an Associate Professor with the KTH Royal Institute of Technology, Stockholm. From 2002 to 2014, he was a Full Professor of electronic systems design at the KTH. Since 2014, he has been a Professor of systems on chips with the Institute of ...Show More
Axel Jantsch (Senior Member, IEEE) received the Dipl.Ing. and Ph.D. degrees in computer science from TU Wien, Vienna, Austria, in 1987 and 1992, respectively. From 1997 to 2002, he was an Associate Professor with the KTH Royal Institute of Technology, Stockholm. From 2002 to 2014, he was a Full Professor of electronic systems design at the KTH. Since 2014, he has been a Professor of systems on chips with the Institute of ...View more

Department of Electronics Design, Mid Sweden University, Sundsvall, Sweden
SCA, Sundsvall, Sweden
Adam Lundström received the M.S. degree in industrial engineering and management from Mid Sweden University and the M.S. degree in computer and systems sciences from Stockholm University, in 2020. He is currently pursuing the Ph.D. degree with the Industrial Graduate School Smart Industry Sweden and studying the potential for machine learning solutions in predictive maintenance. He is employed with SCA and a part of the Department of Electronics Design, Mid Sweden bbreak University.
Adam Lundström received the M.S. degree in industrial engineering and management from Mid Sweden University and the M.S. degree in computer and systems sciences from Stockholm University, in 2020. He is currently pursuing the Ph.D. degree with the Industrial Graduate School Smart Industry Sweden and studying the potential for machine learning solutions in predictive maintenance. He is employed with SCA and a part of the Department of Electronics Design, Mid Sweden bbreak University.View more

Department of Electronics Design, Mid Sweden University, Sundsvall, Sweden
Mattias O’nils received the B.S. degree in electrical engineering from Mid Sweden University, Sundsvall, Sweden, in 1993, and the Licentiate and Ph.D. degrees in electronic systems design from the Royal Institute of Technology, Stockholm, Sweden, in 1996 and 1999, respectively. He is currently a Professor with the Department of Electronics Design and leads the Research Group in Embedded IoT Systems, Mid Sweden University. His current research interests include design methods and implementation of embedded DNN-based systems, especially in the implementation of real-time video processing and time series processing systems.
Mattias O’nils received the B.S. degree in electrical engineering from Mid Sweden University, Sundsvall, Sweden, in 1993, and the Licentiate and Ph.D. degrees in electronic systems design from the Royal Institute of Technology, Stockholm, Sweden, in 1996 and 1999, respectively. He is currently a Professor with the Department of Electronics Design and leads the Research Group in Embedded IoT Systems, Mid Sweden University. His current research interests include design methods and implementation of embedded DNN-based systems, especially in the implementation of real-time video processing and time series processing systems.View more

Department of Electronics Design, Mid Sweden University, Sundsvall, Sweden
Faculty of Science, University of Ontario Institute of Technology, Oshawa, Canada
Faisal Z. Qureshi (Senior Member, IEEE) received the B.Sc. degree in mathematics and physics from Punjab University, Lahore, Pakistan, in 1993, the M.Sc. degree in electronics from Quaid-e-Azam University, Islamabad, Pakistan, in 1995, and the M.Sc. and Ph.D. degrees in computer science from the University of Toronto, Toronto, ON, Canada, in 2000 and 2007, respectively. He is currently a Professor of computer science with the Faculty of Science, Ontario Tech University, where he leads the Visual Computing Laboratory. His research interest includes computer vision. His scientific and engineering interests center on the study of computational models of visual perception to support autonomous, purposeful behavior in the context of ad hoc networks of smart cameras. He is also active in journal special issues and conference organizations. He is a member of ACM and a Secretary and a member of CIPPRS. He served as the General Co-Chair for the Workshop on Camera Networks and Wide-Area Scene Analysis (co-located with CVPR) during 2011–2013. He also served as the Co-Chair for the Computer and Robot Vision (CRV) Conference 2015/2016 meetings.
Faisal Z. Qureshi (Senior Member, IEEE) received the B.Sc. degree in mathematics and physics from Punjab University, Lahore, Pakistan, in 1993, the M.Sc. degree in electronics from Quaid-e-Azam University, Islamabad, Pakistan, in 1995, and the M.Sc. and Ph.D. degrees in computer science from the University of Toronto, Toronto, ON, Canada, in 2000 and 2007, respectively. He is currently a Professor of computer science with the Faculty of Science, Ontario Tech University, where he leads the Visual Computing Laboratory. His research interest includes computer vision. His scientific and engineering interests center on the study of computational models of visual perception to support autonomous, purposeful behavior in the context of ad hoc networks of smart cameras. He is also active in journal special issues and conference organizations. He is a member of ACM and a Secretary and a member of CIPPRS. He served as the General Co-Chair for the Workshop on Camera Networks and Wide-Area Scene Analysis (co-located with CVPR) during 2011–2013. He also served as the Co-Chair for the Computer and Robot Vision (CRV) Conference 2015/2016 meetings.View more

Department of Electronics Design, Mid Sweden University, Sundsvall, Sweden
Institute of Computer Technology, TU Wien, Vienna, Austria
Axel Jantsch (Senior Member, IEEE) received the Dipl.Ing. and Ph.D. degrees in computer science from TU Wien, Vienna, Austria, in 1987 and 1992, respectively. From 1997 to 2002, he was an Associate Professor with the KTH Royal Institute of Technology, Stockholm. From 2002 to 2014, he was a Full Professor of electronic systems design at the KTH. Since 2014, he has been a Professor of systems on chips with the Institute of Computer Technology, TU Wien. He has published five books as an editor and one as the author and over 300 peer-reviewed contributions in journals, books, and conference proceedings. He has given over 100 invited presentations at conferences, universities, and companies. His current research interests include systems on chips, self-aware cyber-physical systems, and embedded machine learning.
Axel Jantsch (Senior Member, IEEE) received the Dipl.Ing. and Ph.D. degrees in computer science from TU Wien, Vienna, Austria, in 1987 and 1992, respectively. From 1997 to 2002, he was an Associate Professor with the KTH Royal Institute of Technology, Stockholm. From 2002 to 2014, he was a Full Professor of electronic systems design at the KTH. Since 2014, he has been a Professor of systems on chips with the Institute of Computer Technology, TU Wien. He has published five books as an editor and one as the author and over 300 peer-reviewed contributions in journals, books, and conference proceedings. He has given over 100 invited presentations at conferences, universities, and companies. His current research interests include systems on chips, self-aware cyber-physical systems, and embedded machine learning.View more