Abstract:
Camera-based face detection and verification have advanced to the point where they are ready to be integrated into myriad applications, from household appliances to Inter...Show MoreMetadata
Abstract:
Camera-based face detection and verification have advanced to the point where they are ready to be integrated into myriad applications, from household appliances to Internet of Things devices to drones. Many of these applications impose stringent constraints on the form-factor, weight, and cost of the camera package that cannot be met by current-generation lens-based imagers. Lensless imaging systems provide an increasingly promising alternative that radically changes the form-factor and reduces the weight and cost of a camera system. However, lensless imagers currently cannot offer the same image resolution and clarity of their lens-based counterparts. This paper details a first-of-its-kind evaluation of the potential and efficacy of lensless imaging systems for face detection and verification. We propose the usage of existing deep learning techniques for face detection and verification that account for the resolution, noise, and artifacts inherent in today's lensless cameras. We demonstrate that both face detection and verification can be performed with high accuracy from the images acquired from lensless cameras, which paves the way to their integration into new applications. A key component of our study is a dataset of 24 112 lensless camera images captured using FlatCam of 88 subjects in a range of different operating conditions.
Published in: IEEE Transactions on Computational Imaging ( Volume: 5, Issue: 2, June 2019)
Referenced in:IEEE Biometrics Compendium
Funding Agency:
Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Jasper Tan received the B.S. degree in electrical engineering and computer science and engineering from Santa Clara University, Santa Clara, CA, USA, in 2015, and the M.S. degree in electrical and computer engineering in 2018 from Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree with the Electrical and Computer Engineering Department. His research interests include computational ima...Show More
Jasper Tan received the B.S. degree in electrical engineering and computer science and engineering from Santa Clara University, Santa Clara, CA, USA, in 2015, and the M.S. degree in electrical and computer engineering in 2018 from Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree with the Electrical and Computer Engineering Department. His research interests include computational ima...View more
Department of Computer Science and Technology, Shanghai Jiao Tong University, Shanghai, China
Li Niu received the B.E. degree from the University of Science and Technology of China, Hefei, China, in 2011 and the Ph.D. degree from Nanyang Technological University, Singapore, in 2017. He is currently an Associate Professor with the Computer Science and Engineering Department, Shanghai Jiao Tong University, Shanghai, China. Before joining Shanghai Jiao Tong University, he was a Postdoctoral Associate with Rice Univer...Show More
Li Niu received the B.E. degree from the University of Science and Technology of China, Hefei, China, in 2011 and the Ph.D. degree from Nanyang Technological University, Singapore, in 2017. He is currently an Associate Professor with the Computer Science and Engineering Department, Shanghai Jiao Tong University, Shanghai, China. Before joining Shanghai Jiao Tong University, he was a Postdoctoral Associate with Rice Univer...View more
Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Jesse K. Adams received the B.Sc. degree in physics from the University of North Florida, Jacksonville, FL, USA, in 2014 and the M.Sc. degree in applied physics in 2017, from Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree with the Applied Physics/Electrical and Computer Engineering Department. His research interests lie in the areas of nanofabrication, nano-optics, neuroengineerin...Show More
Jesse K. Adams received the B.Sc. degree in physics from the University of North Florida, Jacksonville, FL, USA, in 2014 and the M.Sc. degree in applied physics in 2017, from Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree with the Applied Physics/Electrical and Computer Engineering Department. His research interests lie in the areas of nanofabrication, nano-optics, neuroengineerin...View more
Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Vivek Boominathan received the B.Tech degree in electrical engineering from the Indian Institute of Technology Hyderabad, Hyderabad, India, in 2012, and the M.S. degree in 2016, from the Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree. His research interests lie in the areas of computer vision, signal processing, and computational ...Show More
Vivek Boominathan received the B.Tech degree in electrical engineering from the Indian Institute of Technology Hyderabad, Hyderabad, India, in 2012, and the M.S. degree in 2016, from the Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree. His research interests lie in the areas of computer vision, signal processing, and computational ...View more
Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Jacob T. Robinson received the B.S. degree in physics from the University of California, Los Angeles, Los Angeles, CA, USA and the Ph.D. degree in applied physics from Cornell University, Ithaca, NY, USA.
After his Ph.D., he worked as a Postdoctoral Fellow with the Chemistry Department, Harvard University. He is currently an Assistant Professor with the Department of Electrical & Computer Engineering and Bioengineering, Ri...Show More
Jacob T. Robinson received the B.S. degree in physics from the University of California, Los Angeles, Los Angeles, CA, USA and the Ph.D. degree in applied physics from Cornell University, Ithaca, NY, USA.
After his Ph.D., he worked as a Postdoctoral Fellow with the Chemistry Department, Harvard University. He is currently an Assistant Professor with the Department of Electrical & Computer Engineering and Bioengineering, Ri...View more
Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Richard G. Baraniuk is the Victor E. Cameron Professor of Electrical and Computer Engineering, Rice University, Houston, TX, USA and the Founding Director of OpenStax (openstax.org). He holds 28 US and 4 foreign patents. His research interests lie in new theory, algorithms, and hardware for sensing, signal processing, and machine learning. He was the recipient of the DOD Vannevar Bush Faculty Fellow Award (National Securi...Show More
Richard G. Baraniuk is the Victor E. Cameron Professor of Electrical and Computer Engineering, Rice University, Houston, TX, USA and the Founding Director of OpenStax (openstax.org). He holds 28 US and 4 foreign patents. His research interests lie in new theory, algorithms, and hardware for sensing, signal processing, and machine learning. He was the recipient of the DOD Vannevar Bush Faculty Fellow Award (National Securi...View more
Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Ashok Veeraraghavan received the bachelor's degree in electrical engineering from the Indian Institute of Technology, Madras, Chennai, India, in 2002 and the M.S. and Ph.D. degrees from the Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA, in 2004 and 2008, respectively.
He is currently an Associate Professor of Electrical and Computer Engineering, Rice University, Houston, T...Show More
Ashok Veeraraghavan received the bachelor's degree in electrical engineering from the Indian Institute of Technology, Madras, Chennai, India, in 2002 and the M.S. and Ph.D. degrees from the Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA, in 2004 and 2008, respectively.
He is currently an Associate Professor of Electrical and Computer Engineering, Rice University, Houston, T...View more
Contents Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Jasper Tan received the B.S. degree in electrical engineering and computer science and engineering from Santa Clara University, Santa Clara, CA, USA, in 2015, and the M.S. degree in electrical and computer engineering in 2018 from Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree with the Electrical and Computer Engineering Department. His research interests include computational imaging, machine learning, and signal processing.
Jasper Tan received the B.S. degree in electrical engineering and computer science and engineering from Santa Clara University, Santa Clara, CA, USA, in 2015, and the M.S. degree in electrical and computer engineering in 2018 from Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree with the Electrical and Computer Engineering Department. His research interests include computational imaging, machine learning, and signal processing.View more
Department of Computer Science and Technology, Shanghai Jiao Tong University, Shanghai, China
Li Niu received the B.E. degree from the University of Science and Technology of China, Hefei, China, in 2011 and the Ph.D. degree from Nanyang Technological University, Singapore, in 2017. He is currently an Associate Professor with the Computer Science and Engineering Department, Shanghai Jiao Tong University, Shanghai, China. Before joining Shanghai Jiao Tong University, he was a Postdoctoral Associate with Rice University, Houston, TX, USA. His current research interests include machine learning, deep learning, and computer vision.
Li Niu received the B.E. degree from the University of Science and Technology of China, Hefei, China, in 2011 and the Ph.D. degree from Nanyang Technological University, Singapore, in 2017. He is currently an Associate Professor with the Computer Science and Engineering Department, Shanghai Jiao Tong University, Shanghai, China. Before joining Shanghai Jiao Tong University, he was a Postdoctoral Associate with Rice University, Houston, TX, USA. His current research interests include machine learning, deep learning, and computer vision.View more
Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Jesse K. Adams received the B.Sc. degree in physics from the University of North Florida, Jacksonville, FL, USA, in 2014 and the M.Sc. degree in applied physics in 2017, from Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree with the Applied Physics/Electrical and Computer Engineering Department. His research interests lie in the areas of nanofabrication, nano-optics, neuroengineering, and computational imaging.
Jesse K. Adams received the B.Sc. degree in physics from the University of North Florida, Jacksonville, FL, USA, in 2014 and the M.Sc. degree in applied physics in 2017, from Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree with the Applied Physics/Electrical and Computer Engineering Department. His research interests lie in the areas of nanofabrication, nano-optics, neuroengineering, and computational imaging.View more
Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Vivek Boominathan received the B.Tech degree in electrical engineering from the Indian Institute of Technology Hyderabad, Hyderabad, India, in 2012, and the M.S. degree in 2016, from the Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree. His research interests lie in the areas of computer vision, signal processing, and computational imaging.
Vivek Boominathan received the B.Tech degree in electrical engineering from the Indian Institute of Technology Hyderabad, Hyderabad, India, in 2012, and the M.S. degree in 2016, from the Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA, where he is currently working toward the Ph.D. degree. His research interests lie in the areas of computer vision, signal processing, and computational imaging.View more
Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Jacob T. Robinson received the B.S. degree in physics from the University of California, Los Angeles, Los Angeles, CA, USA and the Ph.D. degree in applied physics from Cornell University, Ithaca, NY, USA.
After his Ph.D., he worked as a Postdoctoral Fellow with the Chemistry Department, Harvard University. He is currently an Assistant Professor with the Department of Electrical & Computer Engineering and Bioengineering, Rice University, Houston, TX, USA, and an Adjunct Assistant Professor in neuroscience, Baylor College of Medicine, Houston, TX, USA. He joined Rice University in 2012, where he currently works on nanotechnologies to manipulate and measure brain activity in humans, rodents, and small invertebrates.
Dr. Robinson is currently a Co-Chair of the IEEE Brain Initiative, and the recipient of a Hammill Innovation Award, NSF NeuroNex Innovation Award, Materials Today Rising Star Award, and a DARPA Young Faculty Award.
Jacob T. Robinson received the B.S. degree in physics from the University of California, Los Angeles, Los Angeles, CA, USA and the Ph.D. degree in applied physics from Cornell University, Ithaca, NY, USA.
After his Ph.D., he worked as a Postdoctoral Fellow with the Chemistry Department, Harvard University. He is currently an Assistant Professor with the Department of Electrical & Computer Engineering and Bioengineering, Rice University, Houston, TX, USA, and an Adjunct Assistant Professor in neuroscience, Baylor College of Medicine, Houston, TX, USA. He joined Rice University in 2012, where he currently works on nanotechnologies to manipulate and measure brain activity in humans, rodents, and small invertebrates.
Dr. Robinson is currently a Co-Chair of the IEEE Brain Initiative, and the recipient of a Hammill Innovation Award, NSF NeuroNex Innovation Award, Materials Today Rising Star Award, and a DARPA Young Faculty Award.View more
Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Richard G. Baraniuk is the Victor E. Cameron Professor of Electrical and Computer Engineering, Rice University, Houston, TX, USA and the Founding Director of OpenStax (openstax.org). He holds 28 US and 4 foreign patents. His research interests lie in new theory, algorithms, and hardware for sensing, signal processing, and machine learning. He was the recipient of the DOD Vannevar Bush Faculty Fellow Award (National Security Science and Engineering Faculty Fellow), the IEEE James H. Mulligan, Jr. Education Medal, and IEEE Signal Processing Society Best Paper, Best Column, Education, and Technical Achievement Awards. He is a Fellow of the American Academy of Arts and Sciences, National Academy of Inventors, American Association for the Advancement of Science, and the IEEE.
Richard G. Baraniuk is the Victor E. Cameron Professor of Electrical and Computer Engineering, Rice University, Houston, TX, USA and the Founding Director of OpenStax (openstax.org). He holds 28 US and 4 foreign patents. His research interests lie in new theory, algorithms, and hardware for sensing, signal processing, and machine learning. He was the recipient of the DOD Vannevar Bush Faculty Fellow Award (National Security Science and Engineering Faculty Fellow), the IEEE James H. Mulligan, Jr. Education Medal, and IEEE Signal Processing Society Best Paper, Best Column, Education, and Technical Achievement Awards. He is a Fellow of the American Academy of Arts and Sciences, National Academy of Inventors, American Association for the Advancement of Science, and the IEEE.View more
Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
Ashok Veeraraghavan received the bachelor's degree in electrical engineering from the Indian Institute of Technology, Madras, Chennai, India, in 2002 and the M.S. and Ph.D. degrees from the Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA, in 2004 and 2008, respectively.
He is currently an Associate Professor of Electrical and Computer Engineering, Rice University, Houston, TX, USA. Before joining Rice University, he spent three years as a Research Scientist at Mitsubishi Electric Research Labs, Cambridge, MA, USA. His research interests are broadly in the areas of computational imaging, computer vision, machine learning, and robotics.
Dr. Veeraraghavan's thesis received the Doctoral Dissertation Award from the Department of Electrical and Computer Engineering at the University of Maryland. He is the recipient of the National Science Foundation CAREER Award in 2017. At Rice University, he directs the Computational Imaging and Vision Lab.
Ashok Veeraraghavan received the bachelor's degree in electrical engineering from the Indian Institute of Technology, Madras, Chennai, India, in 2002 and the M.S. and Ph.D. degrees from the Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA, in 2004 and 2008, respectively.
He is currently an Associate Professor of Electrical and Computer Engineering, Rice University, Houston, TX, USA. Before joining Rice University, he spent three years as a Research Scientist at Mitsubishi Electric Research Labs, Cambridge, MA, USA. His research interests are broadly in the areas of computational imaging, computer vision, machine learning, and robotics.
Dr. Veeraraghavan's thesis received the Doctoral Dissertation Award from the Department of Electrical and Computer Engineering at the University of Maryland. He is the recipient of the National Science Foundation CAREER Award in 2017. At Rice University, he directs the Computational Imaging and Vision Lab.View more
