Abstract:
A new method is presented for producing photo collages that preserve content correlation of photos. We use deep learning techniques to find correlation among given photos...Show MoreMetadata
Abstract:
A new method is presented for producing photo collages that preserve content correlation of photos. We use deep learning techniques to find correlation among given photos to facilitate their embedding on the canvas, and develop an efficient combinatorial optimization technique to make correlated photos stay close to each other. To make efficient use of canvas space, our method first extracts salient regions of photos and packs only these salient regions. We allow the salient regions to have arbitrary shapes, therefore yielding informative, yet more compact collages than by other similar collage methods based on salient regions. We present extensive experimental results, user study results, and comparisons against the state-of-the-art methods to show the superiority of our method.
Published in: IEEE Transactions on Visualization and Computer Graphics ( Volume: 24, Issue: 6, 01 June 2018)
Funding Agency:
Department of Computer Science, The University of Hong Kong, Hong Kong, P.R. China
Lingjie Liu received the BEng degree in computer science and
technology from the Huazhong University of Science and Technology. She is working toward the PhD degree in computer
science supervised by Prof. Wenping Wang with the University of Hong Kong. Her research interests include 3D
reconstruction and image processing.
Lingjie Liu received the BEng degree in computer science and
technology from the Huazhong University of Science and Technology. She is working toward the PhD degree in computer
science supervised by Prof. Wenping Wang with the University of Hong Kong. Her research interests include 3D
reconstruction and image processing.View more
National Key Lab for Novel Software Technology, Nanjing University, Nanjing, Jiangsu, P.R. China
Hongjie Zhang is working toward the PhD degree in the National Key
Laboratory for Novel Software Technology, Department of Computer Science and Technology, Nanjing University, Jiangsu,
China. His research interests include computer vision and graphics, digital image processing, and pattern recognition.
Hongjie Zhang is working toward the PhD degree in the National Key
Laboratory for Novel Software Technology, Department of Computer Science and Technology, Nanjing University, Jiangsu,
China. His research interests include computer vision and graphics, digital image processing, and pattern recognition.
View more
Department of Computer Science, The University of Hong Kong, Hong Kong, P.R. China
Guangmei Jing received the BEng degree from the University of Science
and Technology of China, Hefei, China, in 2010 and the PhD degree from the University of Hong Kong, in 2015. She
worked as a research assistant with the State Key Laboratory of CAD & CG, Zhejiang University, Hangzhou, China, in
2010. Her research interests include image/video processing and computer vision.
Guangmei Jing received the BEng degree from the University of Science
and Technology of China, Hefei, China, in 2010 and the PhD degree from the University of Hong Kong, in 2015. She
worked as a research assistant with the State Key Laboratory of CAD & CG, Zhejiang University, Hangzhou, China, in
2010. Her research interests include image/video processing and computer vision.View more
National Key Lab for Novel Software Technology, Nanjing University, Nanjing, Jiangsu, P.R. China
Yanwen Guo received the PhD degree in applied mathematics from the
State Key Lab of CAD & CG, Zhejiang University, China, in 2006. He is currently a full professor in the National
Key Laboratory for Novel Software Technology, Department of Computer Science and Technology, Nanjing University,
Jiangsu, China. He was a visiting professor in the Department of Computer Science and Engineering, The Chinese
University of Hon...Show More
Yanwen Guo received the PhD degree in applied mathematics from the
State Key Lab of CAD & CG, Zhejiang University, China, in 2006. He is currently a full professor in the National
Key Laboratory for Novel Software Technology, Department of Computer Science and Technology, Nanjing University,
Jiangsu, China. He was a visiting professor in the Department of Computer Science and Engineering, The Chinese
University of Hon...View more
Department of Computer Science, Xiamen University, Xiamen, P.R. China
Zhonggui Cheng received the BSc and PhD degrees in applied
mathematics from Zhejiang University, in 2004 and 2009, respectively. He is an associate professor in the Department
of Computer Sciences, School of Information Science and Engineering, Xiamen University, China. His research interests
include computer graphics and computational geometry.
Zhonggui Cheng received the BSc and PhD degrees in applied
mathematics from Zhejiang University, in 2004 and 2009, respectively. He is an associate professor in the Department
of Computer Sciences, School of Information Science and Engineering, Xiamen University, China. His research interests
include computer graphics and computational geometry.View more
Department of Computer Science, The University of Hong Kong, Hong Kong, P.R. China
Wenping Wang received the PhD degree in computer science from the
University of Alberta, in 1992. He is chair professor and head of Computer Science Department, University of Hong
Kong. His research covers computer graphics and geometric computing. He has published more than 120 journal papers in
these fields. He is a fellow of the IEEE.
Wenping Wang received the PhD degree in computer science from the
University of Alberta, in 1992. He is chair professor and head of Computer Science Department, University of Hong
Kong. His research covers computer graphics and geometric computing. He has published more than 120 journal papers in
these fields. He is a fellow of the IEEE.View more
Contents Department of Computer Science, The University of Hong Kong, Hong Kong, P.R. China
Lingjie Liu received the BEng degree in computer science and
technology from the Huazhong University of Science and Technology. She is working toward the PhD degree in computer
science supervised by Prof. Wenping Wang with the University of Hong Kong. Her research interests include 3D
reconstruction and image processing.
Lingjie Liu received the BEng degree in computer science and
technology from the Huazhong University of Science and Technology. She is working toward the PhD degree in computer
science supervised by Prof. Wenping Wang with the University of Hong Kong. Her research interests include 3D
reconstruction and image processing.View more
National Key Lab for Novel Software Technology, Nanjing University, Nanjing, Jiangsu, P.R. China
Hongjie Zhang is working toward the PhD degree in the National Key
Laboratory for Novel Software Technology, Department of Computer Science and Technology, Nanjing University, Jiangsu,
China. His research interests include computer vision and graphics, digital image processing, and pattern recognition.
Hongjie Zhang is working toward the PhD degree in the National Key
Laboratory for Novel Software Technology, Department of Computer Science and Technology, Nanjing University, Jiangsu,
China. His research interests include computer vision and graphics, digital image processing, and pattern recognition.
View more
Department of Computer Science, The University of Hong Kong, Hong Kong, P.R. China
Guangmei Jing received the BEng degree from the University of Science
and Technology of China, Hefei, China, in 2010 and the PhD degree from the University of Hong Kong, in 2015. She
worked as a research assistant with the State Key Laboratory of CAD & CG, Zhejiang University, Hangzhou, China, in
2010. Her research interests include image/video processing and computer vision.
Guangmei Jing received the BEng degree from the University of Science
and Technology of China, Hefei, China, in 2010 and the PhD degree from the University of Hong Kong, in 2015. She
worked as a research assistant with the State Key Laboratory of CAD & CG, Zhejiang University, Hangzhou, China, in
2010. Her research interests include image/video processing and computer vision.View more
National Key Lab for Novel Software Technology, Nanjing University, Nanjing, Jiangsu, P.R. China
Yanwen Guo received the PhD degree in applied mathematics from the
State Key Lab of CAD & CG, Zhejiang University, China, in 2006. He is currently a full professor in the National
Key Laboratory for Novel Software Technology, Department of Computer Science and Technology, Nanjing University,
Jiangsu, China. He was a visiting professor in the Department of Computer Science and Engineering, The Chinese
University of Hong Kong, in 2006 and 2009, respectively, the Department of Computer Science, The University of Hong
Kong, in 2008, 2012, and 2013, respectively, and a visiting scholar in the Department of Electrical and Computer
Engineering, University of Illinois at Urbana-Champaign, from 2013 to 2015. His research interests include image and
video processing, vision, and computer graphics.
Yanwen Guo received the PhD degree in applied mathematics from the
State Key Lab of CAD & CG, Zhejiang University, China, in 2006. He is currently a full professor in the National
Key Laboratory for Novel Software Technology, Department of Computer Science and Technology, Nanjing University,
Jiangsu, China. He was a visiting professor in the Department of Computer Science and Engineering, The Chinese
University of Hong Kong, in 2006 and 2009, respectively, the Department of Computer Science, The University of Hong
Kong, in 2008, 2012, and 2013, respectively, and a visiting scholar in the Department of Electrical and Computer
Engineering, University of Illinois at Urbana-Champaign, from 2013 to 2015. His research interests include image and
video processing, vision, and computer graphics.View more
Department of Computer Science, Xiamen University, Xiamen, P.R. China
Zhonggui Cheng received the BSc and PhD degrees in applied
mathematics from Zhejiang University, in 2004 and 2009, respectively. He is an associate professor in the Department
of Computer Sciences, School of Information Science and Engineering, Xiamen University, China. His research interests
include computer graphics and computational geometry.
Zhonggui Cheng received the BSc and PhD degrees in applied
mathematics from Zhejiang University, in 2004 and 2009, respectively. He is an associate professor in the Department
of Computer Sciences, School of Information Science and Engineering, Xiamen University, China. His research interests
include computer graphics and computational geometry.View more
Department of Computer Science, The University of Hong Kong, Hong Kong, P.R. China
Wenping Wang received the PhD degree in computer science from the
University of Alberta, in 1992. He is chair professor and head of Computer Science Department, University of Hong
Kong. His research covers computer graphics and geometric computing. He has published more than 120 journal papers in
these fields. He is a fellow of the IEEE.
Wenping Wang received the PhD degree in computer science from the
University of Alberta, in 1992. He is chair professor and head of Computer Science Department, University of Hong
Kong. His research covers computer graphics and geometric computing. He has published more than 120 journal papers in
these fields. He is a fellow of the IEEE.View more
