Abstract:
Spatiotemporal analysis of road scenes is a hot research topic in the communities of computer vision and intelligent transportation systems. In this paper, we propose a n...Show MoreMetadata
Abstract:
Spatiotemporal analysis of road scenes is a hot research topic in the communities of computer vision and intelligent transportation systems. In this paper, we propose a new framework for spatiotemporal analysis of static and dynamic traffic elements from road scenes. In the first stage, a bottom-up analysis method for static traffic elements is proposed based on a hierarchical spatiotemporal model using hidden conditional random fields (HCRF). The bottom-level features are extracted from sub-regions in the hierarchical model, and the local and global features of the image sequence are then fully combined for spatial and temporal layers. In the second stage, a lightweight multi-stream 3DCNN network is developed for the behavior classification of dynamic traffic elements, which is composed of three parts. Firstly, a SELayer-3DCNN is designed to extract the appearance, motion and edge information from the image sequences. Secondly, the channel attention fusion strategy (CAF) is introduced to enhance the feature fusion ability. Finally, the 3D-RFB module is incorporated to expand the receptive field of the convolution kernel. The experimental results well demonstrate the effectiveness of the proposed framework.
Published in: IEEE Transactions on Intelligent Transportation Systems ( Volume: 24, Issue: 3, March 2023)
Funding Agency:
School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Yaochen Li (Member, IEEE) received the Ph.D. degree in pattern recognition and intelligent system from Xi’an Jiaotong University, Xi’an, China, in 2016. From December 2012 to January 2014, he was a Visiting Scholar with IPAM, University of California at Los Angeles, Los Angeles, CA, USA. He is currently an Associate Professor with the School of Software Engineering, Xi’an Jiaotong University. His research interests includ...Show More
Yaochen Li (Member, IEEE) received the Ph.D. degree in pattern recognition and intelligent system from Xi’an Jiaotong University, Xi’an, China, in 2016. From December 2012 to January 2014, he was a Visiting Scholar with IPAM, University of California at Los Angeles, Los Angeles, CA, USA. He is currently an Associate Professor with the School of Software Engineering, Xi’an Jiaotong University. His research interests includ...View more
School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Haochuan Hou received the B.E. degree in geographic information science from the China University of Geosciences, Wuhan, China, in June 2017. He is currently pursuing the M.S. degree in software engineering with Xi’an Jiaotong University, Xi’an, China. His research interests include computer vision and deep learning.
Haochuan Hou received the B.E. degree in geographic information science from the China University of Geosciences, Wuhan, China, in June 2017. He is currently pursuing the M.S. degree in software engineering with Xi’an Jiaotong University, Xi’an, China. His research interests include computer vision and deep learning.View more
School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Zikun Dong received the B.E. degree in electrical engineering from the Xiamen University of Technology in 2018 and the M.S. degree in software engineering from Xi’an Jiaotong University in 2021. Her research interests are 3D scene reconstruction and computer vision.
Zikun Dong received the B.E. degree in electrical engineering from the Xiamen University of Technology in 2018 and the M.S. degree in software engineering from Xi’an Jiaotong University in 2021. Her research interests are 3D scene reconstruction and computer vision.View more
School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Yujie Zang received the B.E. degree in automation science and engineering from Xi’an Jiaotong University, Xi’an, China, in 2021, where he is currently pursuing the M.S. degree in computer science and technology. His research interests include computer vision and image processing.
Yujie Zang received the B.E. degree in automation science and engineering from Xi’an Jiaotong University, Xi’an, China, in 2021, where he is currently pursuing the M.S. degree in computer science and technology. His research interests include computer vision and image processing.View more
School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Ying Zhang received the B.E. degree in information management and information system from Beijing Forestry University, Beijing, China, in 2018. She is currently pursuing the M.S. degree in software engineering with Xi’an Jiaotong University, Xi’an, China. Her research interests include computer vision and image processing.
Ying Zhang received the B.E. degree in information management and information system from Beijing Forestry University, Beijing, China, in 2018. She is currently pursuing the M.S. degree in software engineering with Xi’an Jiaotong University, Xi’an, China. Her research interests include computer vision and image processing.View more
School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Yonghong Song (Member, IEEE) is currently a Professor with the School of Software Engineering, Xi’an Jiaotong University. Her current research interests include image and video content understanding, computer vision, pattern recognition, and intelligent systems. Many of her research findings have been applied in industry.
Yonghong Song (Member, IEEE) is currently a Professor with the School of Software Engineering, Xi’an Jiaotong University. Her current research interests include image and video content understanding, computer vision, pattern recognition, and intelligent systems. Many of her research findings have been applied in industry.View more
Contents School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Yaochen Li (Member, IEEE) received the Ph.D. degree in pattern recognition and intelligent system from Xi’an Jiaotong University, Xi’an, China, in 2016. From December 2012 to January 2014, he was a Visiting Scholar with IPAM, University of California at Los Angeles, Los Angeles, CA, USA. He is currently an Associate Professor with the School of Software Engineering, Xi’an Jiaotong University. His research interests include image processing and analysis, computer vision, and intelligent transportation systems.
Yaochen Li (Member, IEEE) received the Ph.D. degree in pattern recognition and intelligent system from Xi’an Jiaotong University, Xi’an, China, in 2016. From December 2012 to January 2014, he was a Visiting Scholar with IPAM, University of California at Los Angeles, Los Angeles, CA, USA. He is currently an Associate Professor with the School of Software Engineering, Xi’an Jiaotong University. His research interests include image processing and analysis, computer vision, and intelligent transportation systems.View more
School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Haochuan Hou received the B.E. degree in geographic information science from the China University of Geosciences, Wuhan, China, in June 2017. He is currently pursuing the M.S. degree in software engineering with Xi’an Jiaotong University, Xi’an, China. His research interests include computer vision and deep learning.
Haochuan Hou received the B.E. degree in geographic information science from the China University of Geosciences, Wuhan, China, in June 2017. He is currently pursuing the M.S. degree in software engineering with Xi’an Jiaotong University, Xi’an, China. His research interests include computer vision and deep learning.View more
School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Zikun Dong received the B.E. degree in electrical engineering from the Xiamen University of Technology in 2018 and the M.S. degree in software engineering from Xi’an Jiaotong University in 2021. Her research interests are 3D scene reconstruction and computer vision.
Zikun Dong received the B.E. degree in electrical engineering from the Xiamen University of Technology in 2018 and the M.S. degree in software engineering from Xi’an Jiaotong University in 2021. Her research interests are 3D scene reconstruction and computer vision.View more
School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Yujie Zang received the B.E. degree in automation science and engineering from Xi’an Jiaotong University, Xi’an, China, in 2021, where he is currently pursuing the M.S. degree in computer science and technology. His research interests include computer vision and image processing.
Yujie Zang received the B.E. degree in automation science and engineering from Xi’an Jiaotong University, Xi’an, China, in 2021, where he is currently pursuing the M.S. degree in computer science and technology. His research interests include computer vision and image processing.View more
School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Ying Zhang received the B.E. degree in information management and information system from Beijing Forestry University, Beijing, China, in 2018. She is currently pursuing the M.S. degree in software engineering with Xi’an Jiaotong University, Xi’an, China. Her research interests include computer vision and image processing.
Ying Zhang received the B.E. degree in information management and information system from Beijing Forestry University, Beijing, China, in 2018. She is currently pursuing the M.S. degree in software engineering with Xi’an Jiaotong University, Xi’an, China. Her research interests include computer vision and image processing.View more
School of Software Engineering, Xi’an Jiaotong University, Xi’an, China
Yonghong Song (Member, IEEE) is currently a Professor with the School of Software Engineering, Xi’an Jiaotong University. Her current research interests include image and video content understanding, computer vision, pattern recognition, and intelligent systems. Many of her research findings have been applied in industry.
Yonghong Song (Member, IEEE) is currently a Professor with the School of Software Engineering, Xi’an Jiaotong University. Her current research interests include image and video content understanding, computer vision, pattern recognition, and intelligent systems. Many of her research findings have been applied in industry.View more
