Abstract:
High-quality and cost-efficient image upscaling design is very important for many real-time video processing applications, especially when the display panel resolution re...Show MoreMetadata
Abstract:
High-quality and cost-efficient image upscaling design is very important for many real-time video processing applications, especially when the display panel resolution reaches ultrahigh definition. Compared with New Edge-Directed Interpolation (NEDI) based implicit edge directional upscaling, explicit methods require less computational resource and more easily reach real-time performance, especially when the required image definition and upscaling ratio are very high. Nevertheless, the investigation of applications of explicit methods in video processing systems remains largely missing arguably because it is commonly believed that explicit edge-directed interpolation tends to introduce unexpected artifacts because of inaccurate detection and hence its image quality is relatively poor. This paper proposes an explicit edge-directed adaptive interpolation method that leverages more sophisticated edge detection and orientation estimation algorithms to avoid misinterpolation, thereby providing similar or even better image quality than those with implicit methods. Targeting the real-time 4K video display system, the proposed edge-directed image upscaling algorithm is further implemented with an efficient very-large-scale integration (VLSI) architecture. The experimental results demonstrate that the proposed interpolation algorithm outperforms previous explicit and implicit edge-directed methods in both objective and subjective tests. The presented VLSI implementation further demonstrates that the maximum output video sequence of the proposed interpolation method can reach 4k × 2k@60 Hz with a reasonable hardware cost.
Published in: IEEE Transactions on Circuits and Systems for Video Technology ( Volume: 26, Issue: 9, September 2016)
Funding Agency:
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Qiubo Chen received the B.S. degree from the Department of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an, China, in 2010, where he is currently working toward the Ph.D. degree with the Institute of Artificial Intelligence and Robotics.
His research interests include image and video processing, coding, and associated very-large-scale integration design.
Qiubo Chen received the B.S. degree from the Department of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an, China, in 2010, where he is currently working toward the Ph.D. degree with the Institute of Artificial Intelligence and Robotics.
His research interests include image and video processing, coding, and associated very-large-scale integration design.View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Hongbin Sun (M’11) received the B.S. and Ph.D. degrees in electrical engineering from Xi’an Jiaotong University, Xi’an, China, in 2003 and 2009, respectively.
He was a Visiting Ph.D. Student with the Electrical, Computer and Systems Engineering Department, Rensselaer Polytechnic Institute, Troy, NY, USA, from 2007 to 2008. He was a Post-Doctoral Fellow with the Computer Science Department, Xi’an Jiaotong University, from 2...Show More
Hongbin Sun (M’11) received the B.S. and Ph.D. degrees in electrical engineering from Xi’an Jiaotong University, Xi’an, China, in 2003 and 2009, respectively.
He was a Visiting Ph.D. Student with the Electrical, Computer and Systems Engineering Department, Rensselaer Polytechnic Institute, Troy, NY, USA, from 2007 to 2008. He was a Post-Doctoral Fellow with the Computer Science Department, Xi’an Jiaotong University, from 2...View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Xuchong Zhang received the master’s degree in control engineering from Xi’an Jiaotong University, Xi’an, China, in 2014, where he is currently working toward the Ph.D. degree in control science and engineering with the Institute of Artificial Intelligence and Robotics.
His research interests include integrated circuit and system for video signal processing and computer vision.
Xuchong Zhang received the master’s degree in control engineering from Xi’an Jiaotong University, Xi’an, China, in 2014, where he is currently working toward the Ph.D. degree in control science and engineering with the Institute of Artificial Intelligence and Robotics.
His research interests include integrated circuit and system for video signal processing and computer vision.View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Huibin Tao received the Ph.D. degree from the Department of Electronics and Information Engineering, Xi’an Jiaotong University, Xi’an, China, in 2014.
He holds a post-doctoral position with the Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University. His research interests include computer vision, digital communication, and very-large-scale integration implementation.
Huibin Tao received the Ph.D. degree from the Department of Electronics and Information Engineering, Xi’an Jiaotong University, Xi’an, China, in 2014.
He holds a post-doctoral position with the Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University. His research interests include computer vision, digital communication, and very-large-scale integration implementation.View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Jie Yang received the B.S. degree in electrical engineering and automation from North China Electric Power University, Beijing, China, in 2011, and the M.S. degree from the Integrated Circuit Design Center, Xi’an Jiaotong University, Xi’an, China, in 2014.
Her research interests include algorithm design and hardware implementation of image and video processing.
Jie Yang received the B.S. degree in electrical engineering and automation from North China Electric Power University, Beijing, China, in 2011, and the M.S. degree from the Integrated Circuit Design Center, Xi’an Jiaotong University, Xi’an, China, in 2014.
Her research interests include algorithm design and hardware implementation of image and video processing.View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Jizhong Zhao (M’12) received the B.S. and M.S. degrees in mathematics and the Ph.D. degree in computer science from Xi’an Jiaotong University, Xi’an, China, in 1992, 1995, and 2001, respectively.
He is a Professor with the Computer Science and Technology Department, Xi’an Jiaotong University. His research interests include computer software, distributed systems, and computer architecture.
Dr. Zhao is a member of the IEEE Co...Show More
Jizhong Zhao (M’12) received the B.S. and M.S. degrees in mathematics and the Ph.D. degree in computer science from Xi’an Jiaotong University, Xi’an, China, in 1992, 1995, and 2001, respectively.
He is a Professor with the Computer Science and Technology Department, Xi’an Jiaotong University. His research interests include computer software, distributed systems, and computer architecture.
Dr. Zhao is a member of the IEEE Co...View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Nanning Zheng (SM’93–F’06) graduated from the Department of Electrical Engineering, Xi’an Jiaotong University, Xi’an, China, in 1975, and received the M.S. degree in information and control engineering from Xi’an Jiaotong University in 1981; and the Ph.D. degree in electrical engineering from Keio University, Yokohama, Japan, in 1985.
He joined Xi’an Jiaotong University in 1975, where he is currently a Professor and the Di...Show More
Nanning Zheng (SM’93–F’06) graduated from the Department of Electrical Engineering, Xi’an Jiaotong University, Xi’an, China, in 1975, and received the M.S. degree in information and control engineering from Xi’an Jiaotong University in 1981; and the Ph.D. degree in electrical engineering from Keio University, Yokohama, Japan, in 1985.
He joined Xi’an Jiaotong University in 1975, where he is currently a Professor and the Di...View more
Contents Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Qiubo Chen received the B.S. degree from the Department of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an, China, in 2010, where he is currently working toward the Ph.D. degree with the Institute of Artificial Intelligence and Robotics.
His research interests include image and video processing, coding, and associated very-large-scale integration design.
Qiubo Chen received the B.S. degree from the Department of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an, China, in 2010, where he is currently working toward the Ph.D. degree with the Institute of Artificial Intelligence and Robotics.
His research interests include image and video processing, coding, and associated very-large-scale integration design.View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Hongbin Sun (M’11) received the B.S. and Ph.D. degrees in electrical engineering from Xi’an Jiaotong University, Xi’an, China, in 2003 and 2009, respectively.
He was a Visiting Ph.D. Student with the Electrical, Computer and Systems Engineering Department, Rensselaer Polytechnic Institute, Troy, NY, USA, from 2007 to 2008. He was a Post-Doctoral Fellow with the Computer Science Department, Xi’an Jiaotong University, from 2009 to 2011. He is currently an Associate Professor with the School of Electronic and Information Engineering, Xi’an Jiaotong University. His research interests include memory hierarchy in computer system, very-large-scale integration architecture for video processing and computer vision, and signal processing system for new memory technology.
Hongbin Sun (M’11) received the B.S. and Ph.D. degrees in electrical engineering from Xi’an Jiaotong University, Xi’an, China, in 2003 and 2009, respectively.
He was a Visiting Ph.D. Student with the Electrical, Computer and Systems Engineering Department, Rensselaer Polytechnic Institute, Troy, NY, USA, from 2007 to 2008. He was a Post-Doctoral Fellow with the Computer Science Department, Xi’an Jiaotong University, from 2009 to 2011. He is currently an Associate Professor with the School of Electronic and Information Engineering, Xi’an Jiaotong University. His research interests include memory hierarchy in computer system, very-large-scale integration architecture for video processing and computer vision, and signal processing system for new memory technology.View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Xuchong Zhang received the master’s degree in control engineering from Xi’an Jiaotong University, Xi’an, China, in 2014, where he is currently working toward the Ph.D. degree in control science and engineering with the Institute of Artificial Intelligence and Robotics.
His research interests include integrated circuit and system for video signal processing and computer vision.
Xuchong Zhang received the master’s degree in control engineering from Xi’an Jiaotong University, Xi’an, China, in 2014, where he is currently working toward the Ph.D. degree in control science and engineering with the Institute of Artificial Intelligence and Robotics.
His research interests include integrated circuit and system for video signal processing and computer vision.View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Huibin Tao received the Ph.D. degree from the Department of Electronics and Information Engineering, Xi’an Jiaotong University, Xi’an, China, in 2014.
He holds a post-doctoral position with the Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University. His research interests include computer vision, digital communication, and very-large-scale integration implementation.
Huibin Tao received the Ph.D. degree from the Department of Electronics and Information Engineering, Xi’an Jiaotong University, Xi’an, China, in 2014.
He holds a post-doctoral position with the Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University. His research interests include computer vision, digital communication, and very-large-scale integration implementation.View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Jie Yang received the B.S. degree in electrical engineering and automation from North China Electric Power University, Beijing, China, in 2011, and the M.S. degree from the Integrated Circuit Design Center, Xi’an Jiaotong University, Xi’an, China, in 2014.
Her research interests include algorithm design and hardware implementation of image and video processing.
Jie Yang received the B.S. degree in electrical engineering and automation from North China Electric Power University, Beijing, China, in 2011, and the M.S. degree from the Integrated Circuit Design Center, Xi’an Jiaotong University, Xi’an, China, in 2014.
Her research interests include algorithm design and hardware implementation of image and video processing.View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Jizhong Zhao (M’12) received the B.S. and M.S. degrees in mathematics and the Ph.D. degree in computer science from Xi’an Jiaotong University, Xi’an, China, in 1992, 1995, and 2001, respectively.
He is a Professor with the Computer Science and Technology Department, Xi’an Jiaotong University. His research interests include computer software, distributed systems, and computer architecture.
Dr. Zhao is a member of the IEEE Computer Society and the Association for Computing Machinery.
Jizhong Zhao (M’12) received the B.S. and M.S. degrees in mathematics and the Ph.D. degree in computer science from Xi’an Jiaotong University, Xi’an, China, in 1992, 1995, and 2001, respectively.
He is a Professor with the Computer Science and Technology Department, Xi’an Jiaotong University. His research interests include computer software, distributed systems, and computer architecture.
Dr. Zhao is a member of the IEEE Computer Society and the Association for Computing Machinery.View more
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China
Nanning Zheng (SM’93–F’06) graduated from the Department of Electrical Engineering, Xi’an Jiaotong University, Xi’an, China, in 1975, and received the M.S. degree in information and control engineering from Xi’an Jiaotong University in 1981; and the Ph.D. degree in electrical engineering from Keio University, Yokohama, Japan, in 1985.
He joined Xi’an Jiaotong University in 1975, where he is currently a Professor and the Director of the Institute of Artificial Intelligence and Robotics. His research interests include computer vision, pattern recognition and image processing, and hardware implementation of intelligent systems.
Dr. Zheng became a member of the Chinese Academy of Engineering in 1999. He is the Chinese Representative on the Governing Board of the International Association for Pattern Recognition. He serves as the President of the Chinese Association of Automation.
Nanning Zheng (SM’93–F’06) graduated from the Department of Electrical Engineering, Xi’an Jiaotong University, Xi’an, China, in 1975, and received the M.S. degree in information and control engineering from Xi’an Jiaotong University in 1981; and the Ph.D. degree in electrical engineering from Keio University, Yokohama, Japan, in 1985.
He joined Xi’an Jiaotong University in 1975, where he is currently a Professor and the Director of the Institute of Artificial Intelligence and Robotics. His research interests include computer vision, pattern recognition and image processing, and hardware implementation of intelligent systems.
Dr. Zheng became a member of the Chinese Academy of Engineering in 1999. He is the Chinese Representative on the Governing Board of the International Association for Pattern Recognition. He serves as the President of the Chinese Association of Automation.View more
