Abstract:
The evolution of high performance computing technologies has enabled the large-scale implementation of neuromorphic models and pushed the research in computational intell...Show MoreMetadata
Abstract:
The evolution of high performance computing technologies has enabled the large-scale implementation of neuromorphic models and pushed the research in computational intelligence into a new era. Among the machine learning applications, unsupervised detection of anomalous streams is especially challenging due to the requirements of detection accuracy and real-time performance. Designing a computing framework that harnesses the growing computing power of the multicore systems while maintaining high sensitivity and specificity to the anomalies is an urgent research topic. In this paper, we propose anomaly recognition and detection (AnRAD), a bioinspired detection framework that performs probabilistic inferences. We analyze the feature dependency and develop a self-structuring method that learns an efficient confabulation network using unlabeled data. This network is capable of fast incremental learning, which continuously refines the knowledge base using streaming data. Compared with several existing anomaly detection approaches, our method provides competitive detection quality. Furthermore, we exploit the massive parallel structure of the AnRAD framework. Our implementations of the detection algorithm on the graphic processing unit and the Xeon Phi coprocessor both obtain substantial speedups over the sequential implementation on general-purpose microprocessor. The framework provides real-time service to concurrent data streams within diversified knowledge contexts, and can be applied to large problems with multiple local patterns. Experimental results demonstrate high computing performance and memory efficiency. For vehicle behavior detection, the framework is able to monitor up to 16000 vehicles (data streams) and their interactions in real time with a single commodity coprocessor, and uses less than 0.2 ms for one testing subject. Finally, the detection network is ported to our spiking neural network simulator to show the potential of adapting to the emerging neurom...
Published in: IEEE Transactions on Neural Networks and Learning Systems ( Volume: 29, Issue: 5, May 2018)
Funding Agency:
Department of Electrical Engineering and Computer Science, Syracuse University, NY, USA
Qiuwen Chen received the B.S. and M.S. degrees in electrical engineering from the Beijing University of Posts and Telecommunications, Beijing, China, in 2009 and 2012 respectively, and the Ph.D. degree from the Department of Electrical Engineering and Computer Science, Syracuse University, Syracuse, NY, USA, in 2016.
He is currently a Software Engineer with Microsoft, Redmond, WA, USA. His current research interests includ...Show More
Qiuwen Chen received the B.S. and M.S. degrees in electrical engineering from the Beijing University of Posts and Telecommunications, Beijing, China, in 2009 and 2012 respectively, and the Ph.D. degree from the Department of Electrical Engineering and Computer Science, Syracuse University, Syracuse, NY, USA, in 2016.
He is currently a Software Engineer with Microsoft, Redmond, WA, USA. His current research interests includ...View more
Air Force Research Laboratory, Information Directorate, RITB, Rome, NY, USA
Ryan Luley received the B.S. degree from the Mathematics Department, St. Lawrence University, Canton, NY, USA, in 2001, and the M.S. degree from the Electrical Engineering and Computer Science Department, Syracuse University, Syracuse, NY, USA, in 2008, where he is currently pursuing the Ph.D. degree with the Electrical Engineering and Computer Science Department.
He was a Software Engineer for Lockheed Martin Management a...Show More
Ryan Luley received the B.S. degree from the Mathematics Department, St. Lawrence University, Canton, NY, USA, in 2001, and the M.S. degree from the Electrical Engineering and Computer Science Department, Syracuse University, Syracuse, NY, USA, in 2008, where he is currently pursuing the Ph.D. degree with the Electrical Engineering and Computer Science Department.
He was a Software Engineer for Lockheed Martin Management a...View more
Air Force Research Laboratory, Information Directorate, RITB, Rome, NY, USA
Qing Wu (M’96) received the B.S. and M.S. degrees from the Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, in 1993 and 1995, respectively, and the Ph.D. degree from the Department of Electrical Engineering, University of Southern California, Los Angeles, CA, USA, in 2002.
He was an Assistant Professor with the Department of Electrical and Computer Engineering, State Unive...Show More
Qing Wu (M’96) received the B.S. and M.S. degrees from the Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, in 1993 and 1995, respectively, and the Ph.D. degree from the Department of Electrical Engineering, University of Southern California, Los Angeles, CA, USA, in 2002.
He was an Assistant Professor with the Department of Electrical and Computer Engineering, State Unive...View more
Air Force Research Laboratory, Information Directorate, RITB, Rome, NY, USA
Morgan Bishop (M’09) received the B.A. degree from the Department of Computer Science, State University of New York at Geneseo, Geneseo, NY, USA, in 2004.
He was the Lead Developer for Jeansee Corporation, Merriam, KS, USA, where he investigated DNA binding algorithms to achieve optimal DNA codes for use in parallel computing architectures. He is currently a Computer Scientist with the United States Air Force Research Labo...Show More
Morgan Bishop (M’09) received the B.A. degree from the Department of Computer Science, State University of New York at Geneseo, Geneseo, NY, USA, in 2004.
He was the Lead Developer for Jeansee Corporation, Merriam, KS, USA, where he investigated DNA binding algorithms to achieve optimal DNA codes for use in parallel computing architectures. He is currently a Computer Scientist with the United States Air Force Research Labo...View more
Air Force Research Laboratory, Information Directorate, RITB, Rome, NY, USA
Office of the Under Secretary of Defense (Acquisition, Technology and Logistics), Washington, DC
Richard W. Linderman (F’01) received the B.S., M.S., and Ph.D. degrees from the Department of Electrical Engineering, Cornell University, Ithaca, NY, USA, in 1980, 1981, and 1984, respectively.
He was commissioned as a Second Lieutenant in 1980. Upon completing four years of graduate studies, he entered active-duty, teaching computer architecture courses and leading related research with the Air Force Institute of Technolo...Show More
Richard W. Linderman (F’01) received the B.S., M.S., and Ph.D. degrees from the Department of Electrical Engineering, Cornell University, Ithaca, NY, USA, in 1980, 1981, and 1984, respectively.
He was commissioned as a Second Lieutenant in 1980. Upon completing four years of graduate studies, he entered active-duty, teaching computer architecture courses and leading related research with the Air Force Institute of Technolo...View more
Department of Electrical Engineering and Computer Science, Syracuse University, NY, USA
Qinru Qiu (M’00) received the B.S. degree from the Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, in 1994, and the M.S. and Ph.D. degrees from the Department of Electrical Engineering, University of Southern California, Los Angeles, CA, USA, in 1998 and 2001, respectively.
She has been an Assistant Professor and then an Associate Professor with the Department of Electric...Show More
Qinru Qiu (M’00) received the B.S. degree from the Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, in 1994, and the M.S. and Ph.D. degrees from the Department of Electrical Engineering, University of Southern California, Los Angeles, CA, USA, in 1998 and 2001, respectively.
She has been an Assistant Professor and then an Associate Professor with the Department of Electric...View more
Contents Department of Electrical Engineering and Computer Science, Syracuse University, NY, USA
Qiuwen Chen received the B.S. and M.S. degrees in electrical engineering from the Beijing University of Posts and Telecommunications, Beijing, China, in 2009 and 2012 respectively, and the Ph.D. degree from the Department of Electrical Engineering and Computer Science, Syracuse University, Syracuse, NY, USA, in 2016.
He is currently a Software Engineer with Microsoft, Redmond, WA, USA. His current research interests include machine learning, neural networks, neuromorphic computing, and high performance computing.
Qiuwen Chen received the B.S. and M.S. degrees in electrical engineering from the Beijing University of Posts and Telecommunications, Beijing, China, in 2009 and 2012 respectively, and the Ph.D. degree from the Department of Electrical Engineering and Computer Science, Syracuse University, Syracuse, NY, USA, in 2016.
He is currently a Software Engineer with Microsoft, Redmond, WA, USA. His current research interests include machine learning, neural networks, neuromorphic computing, and high performance computing.View more
Air Force Research Laboratory, Information Directorate, RITB, Rome, NY, USA
Ryan Luley received the B.S. degree from the Mathematics Department, St. Lawrence University, Canton, NY, USA, in 2001, and the M.S. degree from the Electrical Engineering and Computer Science Department, Syracuse University, Syracuse, NY, USA, in 2008, where he is currently pursuing the Ph.D. degree with the Electrical Engineering and Computer Science Department.
He was a Software Engineer for Lockheed Martin Management and Data Systems, Valley Forge, PA, USA. He is currently a Mathematician with the United States Air Force Research Laboratory, Information Directorate, Rome, NY, USA. His current research interests include general purpose graphics processing unit computing, high performance embedded computing, and parallel discrete event simulation.
Ryan Luley received the B.S. degree from the Mathematics Department, St. Lawrence University, Canton, NY, USA, in 2001, and the M.S. degree from the Electrical Engineering and Computer Science Department, Syracuse University, Syracuse, NY, USA, in 2008, where he is currently pursuing the Ph.D. degree with the Electrical Engineering and Computer Science Department.
He was a Software Engineer for Lockheed Martin Management and Data Systems, Valley Forge, PA, USA. He is currently a Mathematician with the United States Air Force Research Laboratory, Information Directorate, Rome, NY, USA. His current research interests include general purpose graphics processing unit computing, high performance embedded computing, and parallel discrete event simulation.View more
Air Force Research Laboratory, Information Directorate, RITB, Rome, NY, USA
Qing Wu (M’96) received the B.S. and M.S. degrees from the Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, in 1993 and 1995, respectively, and the Ph.D. degree from the Department of Electrical Engineering, University of Southern California, Los Angeles, CA, USA, in 2002.
He was an Assistant Professor with the Department of Electrical and Computer Engineering, State University of New York at Binghamton, Binghamton, NY, USA. He is currently a Principal Electronics Engineer with the United States Air Force Research Laboratory, Information Directorate, Rome, NY, USA. He has authored or co-authored over ninety research papers in international journals and conferences. His current research interests include neuromorphic computing architectures, high-performance computing architectures, deep neural networks, and memristor-based neuromorphic circuits and systems.
Qing Wu (M’96) received the B.S. and M.S. degrees from the Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, in 1993 and 1995, respectively, and the Ph.D. degree from the Department of Electrical Engineering, University of Southern California, Los Angeles, CA, USA, in 2002.
He was an Assistant Professor with the Department of Electrical and Computer Engineering, State University of New York at Binghamton, Binghamton, NY, USA. He is currently a Principal Electronics Engineer with the United States Air Force Research Laboratory, Information Directorate, Rome, NY, USA. He has authored or co-authored over ninety research papers in international journals and conferences. His current research interests include neuromorphic computing architectures, high-performance computing architectures, deep neural networks, and memristor-based neuromorphic circuits and systems.View more
Air Force Research Laboratory, Information Directorate, RITB, Rome, NY, USA
Morgan Bishop (M’09) received the B.A. degree from the Department of Computer Science, State University of New York at Geneseo, Geneseo, NY, USA, in 2004.
He was the Lead Developer for Jeansee Corporation, Merriam, KS, USA, where he investigated DNA binding algorithms to achieve optimal DNA codes for use in parallel computing architectures. He is currently a Computer Scientist with the United States Air Force Research Laboratory, Information Directorate, Rome, NY, USA. He has authored or co-authored over fifteen research papers in journals and conferences throughout the world. His current research interests include scalable algorithm development for heterogeneous high performance computers, basic research in next-generation massively parallel systems, and the development of brain-inspired intelligence models for real-world application.
Morgan Bishop (M’09) received the B.A. degree from the Department of Computer Science, State University of New York at Geneseo, Geneseo, NY, USA, in 2004.
He was the Lead Developer for Jeansee Corporation, Merriam, KS, USA, where he investigated DNA binding algorithms to achieve optimal DNA codes for use in parallel computing architectures. He is currently a Computer Scientist with the United States Air Force Research Laboratory, Information Directorate, Rome, NY, USA. He has authored or co-authored over fifteen research papers in journals and conferences throughout the world. His current research interests include scalable algorithm development for heterogeneous high performance computers, basic research in next-generation massively parallel systems, and the development of brain-inspired intelligence models for real-world application.View more
Air Force Research Laboratory, Information Directorate, RITB, Rome, NY, USA
Office of the Under Secretary of Defense (Acquisition, Technology and Logistics), Washington, DC
Richard W. Linderman (F’01) received the B.S., M.S., and Ph.D. degrees from the Department of Electrical Engineering, Cornell University, Ithaca, NY, USA, in 1980, 1981, and 1984, respectively.
He was commissioned as a Second Lieutenant in 1980. Upon completing four years of graduate studies, he entered active-duty, teaching computer architecture courses and leading related research with the Air Force Institute of Technology. He was assigned to Rome Air Development Center, Rome, NY, USA, in 1988, where he led surveillance signal processing architecture activities. In 1991, he transitioned from active-duty to civil service as a Senior Electronics Engineer with Rome Laboratory, Rome, becoming a Principal Engineer in 1997. During these years, he pioneered three-dimensional packaging of embedded architectures and led the Department of Defense community exploring signal and image processing applications of high performance computers. He is currently the Deputy Director of Information Systems and Cyber Security with the Office of the Under Secretary of Defense (Acquisition, Technology and Logistics). He was a member of the Scientific and Professional Cadre of Senior Executives, and also the Chief Scientist with the Air Force Research Laboratory, Information Directorate, Rome. The Information Directorate leads the discovery, development, and integration of affordable warfighting information technologies for air, space, and cyberspace forces. He serves as the Directorate’s Principal Scientific and Technical Adviser and primary authority for the technical content of the science and technology portfolio. He provides principal technical oversight of a broad spectrum of information technologies, including fusion and exploitation; command and control; advanced architectures; information management; communications and networking; defensive information warfare; and intelligent information systems technologies. He has authored or co-authored over 70 journal, conference and technical papers. He holds six U.S. patents.
Richard W. Linderman (F’01) received the B.S., M.S., and Ph.D. degrees from the Department of Electrical Engineering, Cornell University, Ithaca, NY, USA, in 1980, 1981, and 1984, respectively.
He was commissioned as a Second Lieutenant in 1980. Upon completing four years of graduate studies, he entered active-duty, teaching computer architecture courses and leading related research with the Air Force Institute of Technology. He was assigned to Rome Air Development Center, Rome, NY, USA, in 1988, where he led surveillance signal processing architecture activities. In 1991, he transitioned from active-duty to civil service as a Senior Electronics Engineer with Rome Laboratory, Rome, becoming a Principal Engineer in 1997. During these years, he pioneered three-dimensional packaging of embedded architectures and led the Department of Defense community exploring signal and image processing applications of high performance computers. He is currently the Deputy Director of Information Systems and Cyber Security with the Office of the Under Secretary of Defense (Acquisition, Technology and Logistics). He was a member of the Scientific and Professional Cadre of Senior Executives, and also the Chief Scientist with the Air Force Research Laboratory, Information Directorate, Rome. The Information Directorate leads the discovery, development, and integration of affordable warfighting information technologies for air, space, and cyberspace forces. He serves as the Directorate’s Principal Scientific and Technical Adviser and primary authority for the technical content of the science and technology portfolio. He provides principal technical oversight of a broad spectrum of information technologies, including fusion and exploitation; command and control; advanced architectures; information management; communications and networking; defensive information warfare; and intelligent information systems technologies. He has authored or co-authored over 70 journal, conference and technical papers. He holds six U.S. patents.View more
Department of Electrical Engineering and Computer Science, Syracuse University, NY, USA
Qinru Qiu (M’00) received the B.S. degree from the Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, in 1994, and the M.S. and Ph.D. degrees from the Department of Electrical Engineering, University of Southern California, Los Angeles, CA, USA, in 1998 and 2001, respectively.
She has been an Assistant Professor and then an Associate Professor with the Department of Electrical and Computer Engineering, State University of New York at Binghamton, Binghamton, NY, USA. She is currently a Professor and the Program Director of Computer Engineering with the Department of Electrical Engineering and Computer Science, Syracuse University, Syracuse, NY, USA. Her current research interests include neuromorphic computing and high performance energy efficient computing systems.
Dr. Qiu is the TPC Member of Design, Automation and Test in Europe, Design Automation Conference, International Symposium on Low Power Electronics and Design, International Symposium on Quality Electronic Design, International Conference on Very Large Scale Integration, and International Conference On Computer Aided Design. She served as the Associate Editor of the ACM Transactions on Design Automation of Electronic Systems.
Qinru Qiu (M’00) received the B.S. degree from the Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, in 1994, and the M.S. and Ph.D. degrees from the Department of Electrical Engineering, University of Southern California, Los Angeles, CA, USA, in 1998 and 2001, respectively.
She has been an Assistant Professor and then an Associate Professor with the Department of Electrical and Computer Engineering, State University of New York at Binghamton, Binghamton, NY, USA. She is currently a Professor and the Program Director of Computer Engineering with the Department of Electrical Engineering and Computer Science, Syracuse University, Syracuse, NY, USA. Her current research interests include neuromorphic computing and high performance energy efficient computing systems.
Dr. Qiu is the TPC Member of Design, Automation and Test in Europe, Design Automation Conference, International Symposium on Low Power Electronics and Design, International Symposium on Quality Electronic Design, International Conference on Very Large Scale Integration, and International Conference On Computer Aided Design. She served as the Associate Editor of the ACM Transactions on Design Automation of Electronic Systems.View more
