Abstract:
Image formation is traditionally described by a number of individual models, one for each specific effect in the image formation process. However, it is difficult to aggr...Show MoreMetadata
Abstract:
Image formation is traditionally described by a number of individual models, one for each specific effect in the image formation process. However, it is difficult to aggregate the effects by concatenating such individual models. In this paper, we apply light transport analysis to derive a unified image formation model that represents the radiance along a light ray as a 4-D light field signal and physical phenomena such as lens refraction and blocking as linear transformations or modulations of the light field. This unified mathematical framework allows the entire image formation process to be elegantly described by a single equation. It also allows most geometric and photometric effects of imaging, including perspective transformation, defocus blur, and vignetting, to be represented in both 4-D primal and dual domains. The result matches that of traditional models. Generalizations and applications of this theoretic framework are discussed.
Published in: IEEE Transactions on Image Processing ( Volume: 20, Issue: 2, February 2011)
Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan
Chia-Kai Liang (S'05–M'08) received the B.S. degree in electrical engineering and Ph.D. degree in communication engineering from National Taiwan University, Taipei, Taiwan, in 2004 and 2009, respectively.
From 2006 to 2007, he was a VLSI Design Engineer at Avisonic Corporation. In 2009, he was a Research Intern at Nokia Research Center, Palo Alto, CA. His research interests include computational photography, image processi...Show More
Chia-Kai Liang (S'05–M'08) received the B.S. degree in electrical engineering and Ph.D. degree in communication engineering from National Taiwan University, Taipei, Taiwan, in 2004 and 2009, respectively.
From 2006 to 2007, he was a VLSI Design Engineer at Avisonic Corporation. In 2009, he was a Research Intern at Nokia Research Center, Palo Alto, CA. His research interests include computational photography, image processi...View more
Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA, USA
Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan
Yi-Chang Shih received the B.S. degree in electrical engineering from National Taiwan University, Taipei, Taiwan, in 2009.
He is currently with the Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA. His current research interests are quantum communication, image processing, and light field rendering.
Mr. Shih received International Physics Olympic (IPhO) Silver M...Show More
Yi-Chang Shih received the B.S. degree in electrical engineering from National Taiwan University, Taipei, Taiwan, in 2009.
He is currently with the Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA. His current research interests are quantum communication, image processing, and light field rendering.
Mr. Shih received International Physics Olympic (IPhO) Silver M...View more
Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan
Homer H. Chen (S'83–M'86–SM'01–F'03) received the Ph.D. degree in electrical and computer engineering from the University of Illinois, Urbana- Champaign.
Since 2003, he has been with the College of Electrical Engineering and Computer Science, National Taiwan University, Taipei, Taiwan, where he is currently an Irving T. Ho Chair Professor. Prior to that, he held various research and development management and engineering p...Show More
Homer H. Chen (S'83–M'86–SM'01–F'03) received the Ph.D. degree in electrical and computer engineering from the University of Illinois, Urbana- Champaign.
Since 2003, he has been with the College of Electrical Engineering and Computer Science, National Taiwan University, Taipei, Taiwan, where he is currently an Irving T. Ho Chair Professor. Prior to that, he held various research and development management and engineering p...View more
Contents Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan
Chia-Kai Liang (S'05–M'08) received the B.S. degree in electrical engineering and Ph.D. degree in communication engineering from National Taiwan University, Taipei, Taiwan, in 2004 and 2009, respectively.
From 2006 to 2007, he was a VLSI Design Engineer at Avisonic Corporation. In 2009, he was a Research Intern at Nokia Research Center, Palo Alto, CA. His research interests include computational photography, image processing, computer vision, and multimedia hardware architecture.
Dr. Liang received the CSVT Transactions Best Paper Award in 2008, IPPR Best Dissertation Award, NTU GICE Best Dissertation Award, and IICM Best Dissertation Award in 2009. He is a member of Phi Tau Phi, and a student member of ACM SIGGRAPH.
Chia-Kai Liang (S'05–M'08) received the B.S. degree in electrical engineering and Ph.D. degree in communication engineering from National Taiwan University, Taipei, Taiwan, in 2004 and 2009, respectively.
From 2006 to 2007, he was a VLSI Design Engineer at Avisonic Corporation. In 2009, he was a Research Intern at Nokia Research Center, Palo Alto, CA. His research interests include computational photography, image processing, computer vision, and multimedia hardware architecture.
Dr. Liang received the CSVT Transactions Best Paper Award in 2008, IPPR Best Dissertation Award, NTU GICE Best Dissertation Award, and IICM Best Dissertation Award in 2009. He is a member of Phi Tau Phi, and a student member of ACM SIGGRAPH.View more
Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA, USA
Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan
Yi-Chang Shih received the B.S. degree in electrical engineering from National Taiwan University, Taipei, Taiwan, in 2009.
He is currently with the Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA. His current research interests are quantum communication, image processing, and light field rendering.
Mr. Shih received International Physics Olympic (IPhO) Silver Medal Award in 2004.
Yi-Chang Shih received the B.S. degree in electrical engineering from National Taiwan University, Taipei, Taiwan, in 2009.
He is currently with the Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA. His current research interests are quantum communication, image processing, and light field rendering.
Mr. Shih received International Physics Olympic (IPhO) Silver Medal Award in 2004.View more
Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan
Homer H. Chen (S'83–M'86–SM'01–F'03) received the Ph.D. degree in electrical and computer engineering from the University of Illinois, Urbana- Champaign.
Since 2003, he has been with the College of Electrical Engineering and Computer Science, National Taiwan University, Taipei, Taiwan, where he is currently an Irving T. Ho Chair Professor. Prior to that, he held various research and development management and engineering positions with U.S. companies over a period of 17 years, including AT&T Bell Labs, Rockwell Science Center, iVast, and Digital Island (acquired by Cable & Wireless). He was a U.S. delegate for ISO and ITU standards committees and contributed to the development of many new interactive multimedia technologies that are now part of the MPEG-4 and JPEG-2000 standards. His professional interests lie in the broad area of multimedia signal processing and communications.
Dr. Chen is an Associate Editor of the IEEE Transactions on Circuits and Systems for Video Technology. He served as an Associate Editor for the IEEE Transactions on Image Processing from 1992 to 1994, Guest Editor for IEEE Transactions on Circuits and Systems for Video Technology in 1999, and Associate Editor for Pattern Recognition from 1989 to 1999.
Homer H. Chen (S'83–M'86–SM'01–F'03) received the Ph.D. degree in electrical and computer engineering from the University of Illinois, Urbana- Champaign.
Since 2003, he has been with the College of Electrical Engineering and Computer Science, National Taiwan University, Taipei, Taiwan, where he is currently an Irving T. Ho Chair Professor. Prior to that, he held various research and development management and engineering positions with U.S. companies over a period of 17 years, including AT&T Bell Labs, Rockwell Science Center, iVast, and Digital Island (acquired by Cable & Wireless). He was a U.S. delegate for ISO and ITU standards committees and contributed to the development of many new interactive multimedia technologies that are now part of the MPEG-4 and JPEG-2000 standards. His professional interests lie in the broad area of multimedia signal processing and communications.
Dr. Chen is an Associate Editor of the IEEE Transactions on Circuits and Systems for Video Technology. He served as an Associate Editor for the IEEE Transactions on Image Processing from 1992 to 1994, Guest Editor for IEEE Transactions on Circuits and Systems for Video Technology in 1999, and Associate Editor for Pattern Recognition from 1989 to 1999.View more
