Abstract:
Convolutional neural networks (CNNs) have been shown to deliver standout performance on a wide variety of visual information processing applications. However, this rapidl...Show MoreMetadata
Abstract:
Convolutional neural networks (CNNs) have been shown to deliver standout performance on a wide variety of visual information processing applications. However, this rapidly developing technology has only recently been applied with systematic energy to the problem of picture-quality prediction, primarily because of limitations imposed by a lack of adequate ground-truth human subjective data. This situation has begun to change with the development of promising data-gathering methods that are driving new approaches to deep-learning-based perceptual picture-quality prediction. Here, we assay progress in this rapidly evolving field, focusing, in particular, on new ways to collect large quantities of ground-truth data and on recent CNN-based picture-quality prediction models that deliver excellent results in a large, real-world, picture-quality database.
Published in: IEEE Signal Processing Magazine ( Volume: 34, Issue: 6, November 2017)
Funding Agency:
Department of Electrical and Electronic Engineering, Yonsei University, South Korea
Jongyoo Kim (jongky@yonsei.ac.kr) received his B.S. and M.S. degrees in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2011 and 2013, respectively. He is currently working toward his Ph.D. degree in the Department of Electrical and Electronic Engineering, Yonsei University, South Korea. His research interests include two-dimensional (2-D)/three-dimensional (3-D) image and video proces...Show More
Jongyoo Kim (jongky@yonsei.ac.kr) received his B.S. and M.S. degrees in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2011 and 2013, respectively. He is currently working toward his Ph.D. degree in the Department of Electrical and Electronic Engineering, Yonsei University, South Korea. His research interests include two-dimensional (2-D)/three-dimensional (3-D) image and video proces...View more
Department of Computing, The Hong Kong Polytechnic University
Hui Zeng (cshzeng@comp.polyu.edu.hk) received his M.S. degree from the School of Information and Communication Engineering, Dalian University of Technology, China, in 2016. He is currently pursing his Ph.D. degree in the Department of Computing, The Hong Kong Polytechnic University, under the supervision of Prof. Lei Zhang. His research interests include computer vision, image and video processing, and deep learning.
Hui Zeng (cshzeng@comp.polyu.edu.hk) received his M.S. degree from the School of Information and Communication Engineering, Dalian University of Technology, China, in 2016. He is currently pursing his Ph.D. degree in the Department of Computing, The Hong Kong Polytechnic University, under the supervision of Prof. Lei Zhang. His research interests include computer vision, image and video processing, and deep learning.View more
Department of Computer Science, University of Texas (UT), Austin
Deepti Ghadiyaram (deepti@cs.utexas.edu) received her Ph.D. degree from the Department of Computer Science at the University of Texas (UT) at Austin. Her research interests include image and video processing, computer vision, and machine learning. Her Ph.D. work focused on perceptual image and video quality assessment, particularly on building quality-prediction models for pictures and videos captured in the wild and unde...Show More
Deepti Ghadiyaram (deepti@cs.utexas.edu) received her Ph.D. degree from the Department of Computer Science at the University of Texas (UT) at Austin. Her research interests include image and video processing, computer vision, and machine learning. Her Ph.D. work focused on perceptual image and video quality assessment, particularly on building quality-prediction models for pictures and videos captured in the wild and unde...View more
Department of Electrical and Electronic Engineering, Yonsei University, South Korea
Sanghoon Lee (slee@yonsei.ac.kr) received the B.S. degree from Yonsei University, Seoul, South Korea, in 1989, the M.S. degree from the Korea Advanced Institute of Science and Technology, Seoul, in 1991, and the Ph.D. degree from the University of Texas at Austin, in 2000. He is a full professor in the Department of Electrical and Electronic Engineering, Yonsei University. His research interests include image/video qualit...Show More
Sanghoon Lee (slee@yonsei.ac.kr) received the B.S. degree from Yonsei University, Seoul, South Korea, in 1989, the M.S. degree from the Korea Advanced Institute of Science and Technology, Seoul, in 1991, and the Ph.D. degree from the University of Texas at Austin, in 2000. He is a full professor in the Department of Electrical and Electronic Engineering, Yonsei University. His research interests include image/video qualit...View more
Department of Computing, The Hong Kong Polytechnic University
Lei Zhang (cslzhang@comp.polyu.edu.hk) received his B.S. degree from Shenyang Institute of Aeronautical Engineering, China, and his M.S. and Ph.D. degrees from Northwestern Polytechnical University, Xi'an, China. He is a chair professor in the Department of Computing, The Hong Kong Polytechnic University. His research interests include computer vision, pattern recognition, image and video analysis, and biometrics. He has ...Show More
Lei Zhang (cslzhang@comp.polyu.edu.hk) received his B.S. degree from Shenyang Institute of Aeronautical Engineering, China, and his M.S. and Ph.D. degrees from Northwestern Polytechnical University, Xi'an, China. He is a chair professor in the Department of Computing, The Hong Kong Polytechnic University. His research interests include computer vision, pattern recognition, image and video analysis, and biometrics. He has ...View more
University of Texas, Austin
Alan C. Bovik (bovik@ece.utexas.edu) received the B.S., M.S., and Ph.D. degrees from the University of Illinois in 1980, 1982, and 1984, respectively. He is a Cockrell Family Regents Endowed Chair Professor at the University of Texas at Austin. He received the 2017 Edwin H. Land Medal from the Optical Society of America, a 2015 Prime-Time Emmy Engineering Award, and the 2013 IEEE Signal Processing Society's Society Award....Show More
Alan C. Bovik (bovik@ece.utexas.edu) received the B.S., M.S., and Ph.D. degrees from the University of Illinois in 1980, 1982, and 1984, respectively. He is a Cockrell Family Regents Endowed Chair Professor at the University of Texas at Austin. He received the 2017 Edwin H. Land Medal from the Optical Society of America, a 2015 Prime-Time Emmy Engineering Award, and the 2013 IEEE Signal Processing Society's Society Award....View more
Contents Department of Electrical and Electronic Engineering, Yonsei University, South Korea
Jongyoo Kim (jongky@yonsei.ac.kr) received his B.S. and M.S. degrees in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2011 and 2013, respectively. He is currently working toward his Ph.D. degree in the Department of Electrical and Electronic Engineering, Yonsei University, South Korea. His research interests include two-dimensional (2-D)/three-dimensional (3-D) image and video processing based on the human visual system, quality assessment of 2-D/3-D image and video, 3-D computer vision, and deep learning. He was a recipient of the Global Ph.D. Fellowship by the National Research Foundation of Korea from 2011 to 2016.
Jongyoo Kim (jongky@yonsei.ac.kr) received his B.S. and M.S. degrees in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2011 and 2013, respectively. He is currently working toward his Ph.D. degree in the Department of Electrical and Electronic Engineering, Yonsei University, South Korea. His research interests include two-dimensional (2-D)/three-dimensional (3-D) image and video processing based on the human visual system, quality assessment of 2-D/3-D image and video, 3-D computer vision, and deep learning. He was a recipient of the Global Ph.D. Fellowship by the National Research Foundation of Korea from 2011 to 2016.View more
Department of Computing, The Hong Kong Polytechnic University
Hui Zeng (cshzeng@comp.polyu.edu.hk) received his M.S. degree from the School of Information and Communication Engineering, Dalian University of Technology, China, in 2016. He is currently pursing his Ph.D. degree in the Department of Computing, The Hong Kong Polytechnic University, under the supervision of Prof. Lei Zhang. His research interests include computer vision, image and video processing, and deep learning.
Hui Zeng (cshzeng@comp.polyu.edu.hk) received his M.S. degree from the School of Information and Communication Engineering, Dalian University of Technology, China, in 2016. He is currently pursing his Ph.D. degree in the Department of Computing, The Hong Kong Polytechnic University, under the supervision of Prof. Lei Zhang. His research interests include computer vision, image and video processing, and deep learning.View more
Department of Computer Science, University of Texas (UT), Austin
Deepti Ghadiyaram (deepti@cs.utexas.edu) received her Ph.D. degree from the Department of Computer Science at the University of Texas (UT) at Austin. Her research interests include image and video processing, computer vision, and machine learning. Her Ph.D. work focused on perceptual image and video quality assessment, particularly on building quality-prediction models for pictures and videos captured in the wild and understanding a viewer's time-varying quality of experience while streaming videos. She was a recipient of the UT Austin's Microelectronics and Computer Development Fellowship from 2013 to 2014 and the Graduate Student Fellowship from the Department of Computer Science from 2013 to 2016. She joined Facebook Research in September 2017.
Deepti Ghadiyaram (deepti@cs.utexas.edu) received her Ph.D. degree from the Department of Computer Science at the University of Texas (UT) at Austin. Her research interests include image and video processing, computer vision, and machine learning. Her Ph.D. work focused on perceptual image and video quality assessment, particularly on building quality-prediction models for pictures and videos captured in the wild and understanding a viewer's time-varying quality of experience while streaming videos. She was a recipient of the UT Austin's Microelectronics and Computer Development Fellowship from 2013 to 2014 and the Graduate Student Fellowship from the Department of Computer Science from 2013 to 2016. She joined Facebook Research in September 2017.View more
Department of Electrical and Electronic Engineering, Yonsei University, South Korea
Sanghoon Lee (slee@yonsei.ac.kr) received the B.S. degree from Yonsei University, Seoul, South Korea, in 1989, the M.S. degree from the Korea Advanced Institute of Science and Technology, Seoul, in 1991, and the Ph.D. degree from the University of Texas at Austin, in 2000. He is a full professor in the Department of Electrical and Electronic Engineering, Yonsei University. His research interests include image/video quality assessment, computer vision, graphics, cloud computing, multimedia communications, and wireless networks. He has been an associate editor of IEEE Signal Processing Letters and Journal of Electronic Imaging as well as chair of the IEEE P3333.1 Quality Assessment Working Group. He currently serves as a member of the IEEE Multimedia Signal Processing Technical Committee (TC) and the IEEE IVMSP TC and the APSIPA IVM TC vice chair.
Sanghoon Lee (slee@yonsei.ac.kr) received the B.S. degree from Yonsei University, Seoul, South Korea, in 1989, the M.S. degree from the Korea Advanced Institute of Science and Technology, Seoul, in 1991, and the Ph.D. degree from the University of Texas at Austin, in 2000. He is a full professor in the Department of Electrical and Electronic Engineering, Yonsei University. His research interests include image/video quality assessment, computer vision, graphics, cloud computing, multimedia communications, and wireless networks. He has been an associate editor of IEEE Signal Processing Letters and Journal of Electronic Imaging as well as chair of the IEEE P3333.1 Quality Assessment Working Group. He currently serves as a member of the IEEE Multimedia Signal Processing Technical Committee (TC) and the IEEE IVMSP TC and the APSIPA IVM TC vice chair.View more
Department of Computing, The Hong Kong Polytechnic University
Lei Zhang (cslzhang@comp.polyu.edu.hk) received his B.S. degree from Shenyang Institute of Aeronautical Engineering, China, and his M.S. and Ph.D. degrees from Northwestern Polytechnical University, Xi'an, China. He is a chair professor in the Department of Computing, The Hong Kong Polytechnic University. His research interests include computer vision, pattern recognition, image and video analysis, and biometrics. He has published more than 200 papers in those areas, and, as of 2017, his publications have been cited more than 26,000 times in the literature. He is an associate editor of IEEE Transactions on Image Processing, SIAM Journal on Imaging Sciences, and Image and Vision Computing and was selected as a Web of Science Highly Cited Researcher by Thomson Reuters.
Lei Zhang (cslzhang@comp.polyu.edu.hk) received his B.S. degree from Shenyang Institute of Aeronautical Engineering, China, and his M.S. and Ph.D. degrees from Northwestern Polytechnical University, Xi'an, China. He is a chair professor in the Department of Computing, The Hong Kong Polytechnic University. His research interests include computer vision, pattern recognition, image and video analysis, and biometrics. He has published more than 200 papers in those areas, and, as of 2017, his publications have been cited more than 26,000 times in the literature. He is an associate editor of IEEE Transactions on Image Processing, SIAM Journal on Imaging Sciences, and Image and Vision Computing and was selected as a Web of Science Highly Cited Researcher by Thomson Reuters.View more
University of Texas, Austin
Alan C. Bovik (bovik@ece.utexas.edu) received the B.S., M.S., and Ph.D. degrees from the University of Illinois in 1980, 1982, and 1984, respectively. He is a Cockrell Family Regents Endowed Chair Professor at the University of Texas at Austin. He received the 2017 Edwin H. Land Medal from the Optical Society of America, a 2015 Prime-Time Emmy Engineering Award, and the 2013 IEEE Signal Processing Society's Society Award. He has published The Handbook of Image and Video Processing, Modern Image Quality Assessment, and The Essential Guide to Image and Video Processing. He cofounded and was the longest-serving editor-in-chief of IEEE Transactions on Image Processing. He also created the IEEE International Conference on Image Processing in Austin, Texas, in 1994. He is a Fellow of the IEEE.
Alan C. Bovik (bovik@ece.utexas.edu) received the B.S., M.S., and Ph.D. degrees from the University of Illinois in 1980, 1982, and 1984, respectively. He is a Cockrell Family Regents Endowed Chair Professor at the University of Texas at Austin. He received the 2017 Edwin H. Land Medal from the Optical Society of America, a 2015 Prime-Time Emmy Engineering Award, and the 2013 IEEE Signal Processing Society's Society Award. He has published The Handbook of Image and Video Processing, Modern Image Quality Assessment, and The Essential Guide to Image and Video Processing. He cofounded and was the longest-serving editor-in-chief of IEEE Transactions on Image Processing. He also created the IEEE International Conference on Image Processing in Austin, Texas, in 1994. He is a Fellow of the IEEE.View more
