Abstract:
The decreasing cost and size of video sensors has led to camera networks becoming pervasive in our lives. However, the ability to analyze these images effectively is very...Show MoreMetadata
Abstract:
The decreasing cost and size of video sensors has led to camera networks becoming pervasive in our lives. However, the ability to analyze these images effectively is very much a function of the quality of the acquired images. In this paper, we consider the problem of automatically controlling the fields of view of individual pan-tilt-zoom (PTZ) cameras in a camera network leading to improved situation awareness (e.g., where and what are the critical targets and events) in a region of interest. The network of cameras attempts to observe the entire region of interest at some minimum resolution while opportunistically acquiring high resolution images of critical events in real time. Since many activities involve groups of people interacting, an important decision that the network needs to make is whether to focus on individuals or groups of them. This is achieved by understanding the performance of video analysis tasks and designing camera control strategies to improve a metric that quantifies the quality of the source imagery. Optimization strategies, along with a distributed implementation, are proposed, and their theoretical properties analyzed. The proposed methods bring together computer vision and network control ideas. The performance of the proposed methodologies discussed herein has been evaluated on a real-life wireless network of PTZ capable cameras.
Published in: IEEE Transactions on Circuits and Systems for Video Technology ( Volume: 27, Issue: 3, March 2017)
Funding Agency:
Department of Computer Science and Engineering, University of California at Riverside, Riverside, CA, USA
Chong Ding (S’10) received the B.S. and Ph.D. degrees in computer science from the University of California at Riverside, Riverside, CA, USA, in 2008 and 2013, respectively.
He is currently a Research Staff Member with the Information and System Sciences Laboratory, HRL Laboratories, LLC, Malibu, CA, USA. He has authored several technical publications on intelligent camera networks. His current research interests include a...Show More
Chong Ding (S’10) received the B.S. and Ph.D. degrees in computer science from the University of California at Riverside, Riverside, CA, USA, in 2008 and 2013, respectively.
He is currently a Research Staff Member with the Information and System Sciences Laboratory, HRL Laboratories, LLC, Malibu, CA, USA. He has authored several technical publications on intelligent camera networks. His current research interests include a...View more
Department of Electrical and Computer Engineering, University of California at Riverside, Riverside, CA, USA
Jawadul H. Bappy (S’16) received the B.S. degree in electrical and electronic engineering from the Bangladesh University of Engineering and Technology, Dhaka, Bangladesh, in 2012. He is currently pursuing the Ph.D. degree in electrical and computer engineering with the University of California at Riverside, Riverside, CA, USA.
His current research interests include wide area scene analysis, scene understanding, object reco...Show More
Jawadul H. Bappy (S’16) received the B.S. degree in electrical and electronic engineering from the Bangladesh University of Engineering and Technology, Dhaka, Bangladesh, in 2012. He is currently pursuing the Ph.D. degree in electrical and computer engineering with the University of California at Riverside, Riverside, CA, USA.
His current research interests include wide area scene analysis, scene understanding, object reco...View more
Department of Electrical and Computer Engineering, University of California at Riverside, Riverside, CA, USA
Jay A. Farrell received the B.S. degrees in physics and electrical engineering from Iowa State University, Ames, IA, USA, and the M.S. and Ph.D. degrees in electrical engineering from the University of Notre Dame, Notre Dame, IN, USA.
He is currently a Professor and two-time Chair of the Department of Electrical Engineering with the University of California at Riverside, Riverside, CA, USA. He has authored over 200 technic...Show More
Jay A. Farrell received the B.S. degrees in physics and electrical engineering from Iowa State University, Ames, IA, USA, and the M.S. and Ph.D. degrees in electrical engineering from the University of Notre Dame, Notre Dame, IN, USA.
He is currently a Professor and two-time Chair of the Department of Electrical Engineering with the University of California at Riverside, Riverside, CA, USA. He has authored over 200 technic...View more
Department of Electrical and Computer Engineering, University of California at Riverside, Riverside, CA, USA
Amit K. Roy-Chowdhury (SM’98) received the bachelor’s degree in electrical engineering from Jadavpur University, Kolkata, India, the master’s degree in systems science and automation from the Indian Institute of Science, Bangalore, India, and the Ph.D. degree in electrical engineering from the University of Maryland, College Park, MD, USA.
He is currently a Professor of Electrical Engineering and a Cooperating Faculty Memb...Show More
Amit K. Roy-Chowdhury (SM’98) received the bachelor’s degree in electrical engineering from Jadavpur University, Kolkata, India, the master’s degree in systems science and automation from the Indian Institute of Science, Bangalore, India, and the Ph.D. degree in electrical engineering from the University of Maryland, College Park, MD, USA.
He is currently a Professor of Electrical Engineering and a Cooperating Faculty Memb...View more
Contents Department of Computer Science and Engineering, University of California at Riverside, Riverside, CA, USA
Chong Ding (S’10) received the B.S. and Ph.D. degrees in computer science from the University of California at Riverside, Riverside, CA, USA, in 2008 and 2013, respectively.
He is currently a Research Staff Member with the Information and System Sciences Laboratory, HRL Laboratories, LLC, Malibu, CA, USA. He has authored several technical publications on intelligent camera networks. His current research interests include autonomous vehicles, mobile ad-hoc networks, network security, and distributed and real-time systems.
Chong Ding (S’10) received the B.S. and Ph.D. degrees in computer science from the University of California at Riverside, Riverside, CA, USA, in 2008 and 2013, respectively.
He is currently a Research Staff Member with the Information and System Sciences Laboratory, HRL Laboratories, LLC, Malibu, CA, USA. He has authored several technical publications on intelligent camera networks. His current research interests include autonomous vehicles, mobile ad-hoc networks, network security, and distributed and real-time systems.View more
Department of Electrical and Computer Engineering, University of California at Riverside, Riverside, CA, USA
Jawadul H. Bappy (S’16) received the B.S. degree in electrical and electronic engineering from the Bangladesh University of Engineering and Technology, Dhaka, Bangladesh, in 2012. He is currently pursuing the Ph.D. degree in electrical and computer engineering with the University of California at Riverside, Riverside, CA, USA.
His current research interests include wide area scene analysis, scene understanding, object recognition, and machine learning.
Jawadul H. Bappy (S’16) received the B.S. degree in electrical and electronic engineering from the Bangladesh University of Engineering and Technology, Dhaka, Bangladesh, in 2012. He is currently pursuing the Ph.D. degree in electrical and computer engineering with the University of California at Riverside, Riverside, CA, USA.
His current research interests include wide area scene analysis, scene understanding, object recognition, and machine learning.View more
Department of Electrical and Computer Engineering, University of California at Riverside, Riverside, CA, USA
Jay A. Farrell received the B.S. degrees in physics and electrical engineering from Iowa State University, Ames, IA, USA, and the M.S. and Ph.D. degrees in electrical engineering from the University of Notre Dame, Notre Dame, IN, USA.
He is currently a Professor and two-time Chair of the Department of Electrical Engineering with the University of California at Riverside, Riverside, CA, USA. He has authored over 200 technical publications and the book entitled Aided Navigation: GPS With High Rate Sensors (McGraw-Hill, 2008). He has co-authored the books entitled The Global Positioning System and Inertial Navigation (McGraw-Hill, 1998) and Adaptive Approximation Based Control: Unifying Neural, Fuzzy and Traditional Adaptive Approximation Approaches (John Wiley, 2006). His current research interests include applied research related to estimation, planning, and control of intelligent autonomous agents.
Dr. Farrell is a fellow of the American Association for the Advancement of Science and a Distinguished Member of the IEEE Control Systems Society (CSS). He has served as the Vice President Finance and Vice President of Technical Activities of the IEEE CSS, and served as the General Chair of the IEEE CDC in 2012 and the President in 2014.
Jay A. Farrell received the B.S. degrees in physics and electrical engineering from Iowa State University, Ames, IA, USA, and the M.S. and Ph.D. degrees in electrical engineering from the University of Notre Dame, Notre Dame, IN, USA.
He is currently a Professor and two-time Chair of the Department of Electrical Engineering with the University of California at Riverside, Riverside, CA, USA. He has authored over 200 technical publications and the book entitled Aided Navigation: GPS With High Rate Sensors (McGraw-Hill, 2008). He has co-authored the books entitled The Global Positioning System and Inertial Navigation (McGraw-Hill, 1998) and Adaptive Approximation Based Control: Unifying Neural, Fuzzy and Traditional Adaptive Approximation Approaches (John Wiley, 2006). His current research interests include applied research related to estimation, planning, and control of intelligent autonomous agents.
Dr. Farrell is a fellow of the American Association for the Advancement of Science and a Distinguished Member of the IEEE Control Systems Society (CSS). He has served as the Vice President Finance and Vice President of Technical Activities of the IEEE CSS, and served as the General Chair of the IEEE CDC in 2012 and the President in 2014.View more
Department of Electrical and Computer Engineering, University of California at Riverside, Riverside, CA, USA
Amit K. Roy-Chowdhury (SM’98) received the bachelor’s degree in electrical engineering from Jadavpur University, Kolkata, India, the master’s degree in systems science and automation from the Indian Institute of Science, Bangalore, India, and the Ph.D. degree in electrical engineering from the University of Maryland, College Park, MD, USA.
He is currently a Professor of Electrical Engineering and a Cooperating Faculty Member with the Department of Computer Science, University of California at Riverside, Riverside, CA, USA. He has co-authored two books entitled Camera Networks: The Acquisition and Analysis of Videos Over Wide Areas and Recognition of Humans and Their Activities Using Video. He is the Editor of the book entitled Distributed Video Sensor Networks. His current research interests include the areas of image processing and analysis, computer vision, video communications and statistical methods for signal analysis, intelligent camera networks, wide-area scene analysis, motion analysis in video, activity recognition and search, video-based biometrics (face and gait), biological video analysis, and distributed video compression.
Dr. Roy-Chowdhury has been on the organizing and program committees of multiple computer vision and image processing conferences and is serving on the editorial boards of multiple journals.
Amit K. Roy-Chowdhury (SM’98) received the bachelor’s degree in electrical engineering from Jadavpur University, Kolkata, India, the master’s degree in systems science and automation from the Indian Institute of Science, Bangalore, India, and the Ph.D. degree in electrical engineering from the University of Maryland, College Park, MD, USA.
He is currently a Professor of Electrical Engineering and a Cooperating Faculty Member with the Department of Computer Science, University of California at Riverside, Riverside, CA, USA. He has co-authored two books entitled Camera Networks: The Acquisition and Analysis of Videos Over Wide Areas and Recognition of Humans and Their Activities Using Video. He is the Editor of the book entitled Distributed Video Sensor Networks. His current research interests include the areas of image processing and analysis, computer vision, video communications and statistical methods for signal analysis, intelligent camera networks, wide-area scene analysis, motion analysis in video, activity recognition and search, video-based biometrics (face and gait), biological video analysis, and distributed video compression.
Dr. Roy-Chowdhury has been on the organizing and program committees of multiple computer vision and image processing conferences and is serving on the editorial boards of multiple journals.View more
