Abstract:
This article presents a novel panoramic stitching solution for real-time monitoring of longwall mining faces, addressing significant parallax issues inherent in undergrou...Show MoreMetadata
Abstract:
This article presents a novel panoramic stitching solution for real-time monitoring of longwall mining faces, addressing significant parallax issues inherent in underground environments. Using a depth camera array and leveraging a local point cloud registration method, our method enhances real-time monitoring, ensuring precise scene alignment measurement and object placement in dynamic environments. Furthermore, we introduce depth completion to resolve issues related to incomplete depth data and propose a scan projection method to maintain image integrity in constrained, tunnel-like spaces. Our system has been validated in both real and simulated environments. The experimental results demonstrate superior performance compared to existing state-of-the-art methods, with an operational speed of 25 fps.
Published in: IEEE Transactions on Instrumentation and Measurement ( Volume: 74)
Funding Agency:
School of Telecommunications Engineering, Xidian University, Xi’an, China
Jiayang Nie received the B.S. degree from the School of Communication Engineering, Xidian University, Xi’an, China, in 2019, where he is currently pursuing the Ph.D. degree.
His research interests include camera array computational imaging and 3-D reconstruction.
Jiayang Nie received the B.S. degree from the School of Communication Engineering, Xidian University, Xi’an, China, in 2019, where he is currently pursuing the Ph.D. degree.
His research interests include camera array computational imaging and 3-D reconstruction.View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Jing Li (Member, IEEE) received the Ph.D. degree in control theory and engineering from Northwestern Polytechnical University, Xi’an, China, in 2008.
She is a Full Professor with the School of Telecommunications Engineering, Xidian University, Xi’an, and she is serving as the Leader with the Intelligent Signal Processing and Pattern Recognition Laboratory. She was a Visiting Scholar with the University of Delaware, Newark,...Show More
Jing Li (Member, IEEE) received the Ph.D. degree in control theory and engineering from Northwestern Polytechnical University, Xi’an, China, in 2008.
She is a Full Professor with the School of Telecommunications Engineering, Xidian University, Xi’an, and she is serving as the Leader with the Intelligent Signal Processing and Pattern Recognition Laboratory. She was a Visiting Scholar with the University of Delaware, Newark,...View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Guodong Zhang received the B.S. degree from the School of Software, North University of China, Taiyuan, China, in 2022. He is currently pursuing the M.S. degree with the School of Telecommunications Engineering, Xidian University, Xi’an, China.
His research interests include holographic communication and 3-D reconstruction.
Guodong Zhang received the B.S. degree from the School of Software, North University of China, Taiyuan, China, in 2022. He is currently pursuing the M.S. degree with the School of Telecommunications Engineering, Xidian University, Xi’an, China.
His research interests include holographic communication and 3-D reconstruction.View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Yuqi Jiang received the B.S. degree from the School of Communication Engineering, Hangzhou Dianzi University, Hangzhou, China, in 2019. He is currently pursuing the Ph.D. degree with the School of Telecommunications Engineering, Xidian University, Xi’an, China.
His research interests include array computational imaging and 3-D reconstructions.
Yuqi Jiang received the B.S. degree from the School of Communication Engineering, Hangzhou Dianzi University, Hangzhou, China, in 2019. He is currently pursuing the Ph.D. degree with the School of Telecommunications Engineering, Xidian University, Xi’an, China.
His research interests include array computational imaging and 3-D reconstructions.View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Canbin Zhang received the B.S. degree in information science and engineering from the University of Jinan, Shandong, China, in 2022. He is currently pursuing the M.S. degree in telecommunications engineering with Xidian University, Xi’an, China.
His research interests include multiple view geometry, neural rendering, and 3-D reconstruction.
Canbin Zhang received the B.S. degree in information science and engineering from the University of Jinan, Shandong, China, in 2022. He is currently pursuing the M.S. degree in telecommunications engineering with Xidian University, Xi’an, China.
His research interests include multiple view geometry, neural rendering, and 3-D reconstruction.View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Jianxing Song received the B.S. degree in electronic information science and technology from Jiangxi University of Science and Technology, Nanchang, China, in 2022. He is currently pursuing the M.S. degree in information and communication engineering with Xidian University, Xi’an, China.
His research interests include camera array-based 3-D reconstruction.
Jianxing Song received the B.S. degree in electronic information science and technology from Jiangxi University of Science and Technology, Nanchang, China, in 2022. He is currently pursuing the M.S. degree in information and communication engineering with Xidian University, Xi’an, China.
His research interests include camera array-based 3-D reconstruction.View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Jing Liu received the B.S. degree from the College of Information and Communication Engineering, North University of China, Taiyuan, China, in 2022. She is currently pursuing the M.S. degree with the School of Communication Engineering, Xidian University, Xi’an, China.
Her research interests include camera array-based 3-D reconstruction.
Jing Liu received the B.S. degree from the College of Information and Communication Engineering, North University of China, Taiyuan, China, in 2022. She is currently pursuing the M.S. degree with the School of Communication Engineering, Xidian University, Xi’an, China.
Her research interests include camera array-based 3-D reconstruction.View more
School of Computer Science, National Engineering Laboratory for Integrated Aerospace-Ground-Ocean Big Data Application Technology, Northwestern Polytechnical University, Xi’an, China
Tao Yang (Member, IEEE) received the Ph.D. degree in control theory and engineering from Northwestern Polytechnical University, Xi’an, China, in 2008.
He is a Full Professor with the School of Computer Science, National Engineering Laboratory for Integrated Aerospace-Ground-Ocean Big Data Application Technology, Northwestern Polytechnical University. He was a Visiting Scholar with the University of Delaware, Newark, DE, US...Show More
Tao Yang (Member, IEEE) received the Ph.D. degree in control theory and engineering from Northwestern Polytechnical University, Xi’an, China, in 2008.
He is a Full Professor with the School of Computer Science, National Engineering Laboratory for Integrated Aerospace-Ground-Ocean Big Data Application Technology, Northwestern Polytechnical University. He was a Visiting Scholar with the University of Delaware, Newark, DE, US...View more
Contents School of Telecommunications Engineering, Xidian University, Xi’an, China
Jiayang Nie received the B.S. degree from the School of Communication Engineering, Xidian University, Xi’an, China, in 2019, where he is currently pursuing the Ph.D. degree.
His research interests include camera array computational imaging and 3-D reconstruction.
Jiayang Nie received the B.S. degree from the School of Communication Engineering, Xidian University, Xi’an, China, in 2019, where he is currently pursuing the Ph.D. degree.
His research interests include camera array computational imaging and 3-D reconstruction.View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Jing Li (Member, IEEE) received the Ph.D. degree in control theory and engineering from Northwestern Polytechnical University, Xi’an, China, in 2008.
She is a Full Professor with the School of Telecommunications Engineering, Xidian University, Xi’an, and she is serving as the Leader with the Intelligent Signal Processing and Pattern Recognition Laboratory. She was a Visiting Scholar with the University of Delaware, Newark, DE, USA, from 2013 to 2014. Before that, she was a Research Assistant with the Department of Computing, Hong Kong Polytechnic University, Hong Kong, in 2008, and a Visiting Scholar with the National Laboratory of Pattern Recognition (NLPR), Beijing, China, from 2004 to 2005. She has published over 50 research papers in international journals and conference proceedings in the areas of computer vision and pattern recognition. Her research interests include camera array, computational imaging, and intelligent visual perception.
Jing Li (Member, IEEE) received the Ph.D. degree in control theory and engineering from Northwestern Polytechnical University, Xi’an, China, in 2008.
She is a Full Professor with the School of Telecommunications Engineering, Xidian University, Xi’an, and she is serving as the Leader with the Intelligent Signal Processing and Pattern Recognition Laboratory. She was a Visiting Scholar with the University of Delaware, Newark, DE, USA, from 2013 to 2014. Before that, she was a Research Assistant with the Department of Computing, Hong Kong Polytechnic University, Hong Kong, in 2008, and a Visiting Scholar with the National Laboratory of Pattern Recognition (NLPR), Beijing, China, from 2004 to 2005. She has published over 50 research papers in international journals and conference proceedings in the areas of computer vision and pattern recognition. Her research interests include camera array, computational imaging, and intelligent visual perception.View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Guodong Zhang received the B.S. degree from the School of Software, North University of China, Taiyuan, China, in 2022. He is currently pursuing the M.S. degree with the School of Telecommunications Engineering, Xidian University, Xi’an, China.
His research interests include holographic communication and 3-D reconstruction.
Guodong Zhang received the B.S. degree from the School of Software, North University of China, Taiyuan, China, in 2022. He is currently pursuing the M.S. degree with the School of Telecommunications Engineering, Xidian University, Xi’an, China.
His research interests include holographic communication and 3-D reconstruction.View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Yuqi Jiang received the B.S. degree from the School of Communication Engineering, Hangzhou Dianzi University, Hangzhou, China, in 2019. He is currently pursuing the Ph.D. degree with the School of Telecommunications Engineering, Xidian University, Xi’an, China.
His research interests include array computational imaging and 3-D reconstructions.
Yuqi Jiang received the B.S. degree from the School of Communication Engineering, Hangzhou Dianzi University, Hangzhou, China, in 2019. He is currently pursuing the Ph.D. degree with the School of Telecommunications Engineering, Xidian University, Xi’an, China.
His research interests include array computational imaging and 3-D reconstructions.View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Canbin Zhang received the B.S. degree in information science and engineering from the University of Jinan, Shandong, China, in 2022. He is currently pursuing the M.S. degree in telecommunications engineering with Xidian University, Xi’an, China.
His research interests include multiple view geometry, neural rendering, and 3-D reconstruction.
Canbin Zhang received the B.S. degree in information science and engineering from the University of Jinan, Shandong, China, in 2022. He is currently pursuing the M.S. degree in telecommunications engineering with Xidian University, Xi’an, China.
His research interests include multiple view geometry, neural rendering, and 3-D reconstruction.View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Jianxing Song received the B.S. degree in electronic information science and technology from Jiangxi University of Science and Technology, Nanchang, China, in 2022. He is currently pursuing the M.S. degree in information and communication engineering with Xidian University, Xi’an, China.
His research interests include camera array-based 3-D reconstruction.
Jianxing Song received the B.S. degree in electronic information science and technology from Jiangxi University of Science and Technology, Nanchang, China, in 2022. He is currently pursuing the M.S. degree in information and communication engineering with Xidian University, Xi’an, China.
His research interests include camera array-based 3-D reconstruction.View more
School of Telecommunications Engineering, Xidian University, Xi’an, China
Jing Liu received the B.S. degree from the College of Information and Communication Engineering, North University of China, Taiyuan, China, in 2022. She is currently pursuing the M.S. degree with the School of Communication Engineering, Xidian University, Xi’an, China.
Her research interests include camera array-based 3-D reconstruction.
Jing Liu received the B.S. degree from the College of Information and Communication Engineering, North University of China, Taiyuan, China, in 2022. She is currently pursuing the M.S. degree with the School of Communication Engineering, Xidian University, Xi’an, China.
Her research interests include camera array-based 3-D reconstruction.View more
School of Computer Science, National Engineering Laboratory for Integrated Aerospace-Ground-Ocean Big Data Application Technology, Northwestern Polytechnical University, Xi’an, China
Tao Yang (Member, IEEE) received the Ph.D. degree in control theory and engineering from Northwestern Polytechnical University, Xi’an, China, in 2008.
He is a Full Professor with the School of Computer Science, National Engineering Laboratory for Integrated Aerospace-Ground-Ocean Big Data Application Technology, Northwestern Polytechnical University. He was a Visiting Scholar with the University of Delaware, Newark, DE, USA, from 2013 to 2014. He was a Research Intern with the FX Palo Alto Laboratory (FXPAL), Palo Alto, CA, USA, from 2006 to 2007, and a Visiting Scholar with the Intelligent Video Surveillance Group, National Laboratory of Pattern Recognition (NLPR), Beijing, China, from 2004 to 2005, and Microsoft Research Asia. His research interests include camera array imaging, visual SLAM, and intelligent visual perception. He has published over 50 research papers in these fields.
Tao Yang (Member, IEEE) received the Ph.D. degree in control theory and engineering from Northwestern Polytechnical University, Xi’an, China, in 2008.
He is a Full Professor with the School of Computer Science, National Engineering Laboratory for Integrated Aerospace-Ground-Ocean Big Data Application Technology, Northwestern Polytechnical University. He was a Visiting Scholar with the University of Delaware, Newark, DE, USA, from 2013 to 2014. He was a Research Intern with the FX Palo Alto Laboratory (FXPAL), Palo Alto, CA, USA, from 2006 to 2007, and a Visiting Scholar with the Intelligent Video Surveillance Group, National Laboratory of Pattern Recognition (NLPR), Beijing, China, from 2004 to 2005, and Microsoft Research Asia. His research interests include camera array imaging, visual SLAM, and intelligent visual perception. He has published over 50 research papers in these fields.View more
