Abstract:
Automatic driving vehicles have been developed to provide more convenient and comfortable driving experiences. However, these vehicles failed in satisfying the variance o...Show MoreMetadata
Abstract:
Automatic driving vehicles have been developed to provide more convenient and comfortable driving experiences. However, these vehicles failed in satisfying the variance of human intentions. Recently, the strategy of collaborating brain-computer interface (BCI) controlling and automatic driving receives attention. Since the BCI system remained some limitation in real-time controlling, a fusion method has been proposed to explore and verify the feasibility of human-vehicle collaborative driving in this paper. A hybrid BCI was developed to interpret human intentions. In addition, a computer vision-based automatic driving component was developed to maintain the vehicle on the road. A system for fusing these two kinds of vehicle driving decisions was first proposed in this paper. This system can simultaneously obtain the visual data and the hybrid electroencephalograph (EEG) signals. The hybrid EEG signals consist of steady-state visual evoked potentials and motor imagery. The obtained multisource information can be fused to make the final decision to drive a simulated vehicle. The proposed system was evaluated with different destinations. The experimental results verify the feasibility of fusing both human intention and computer vision. The task success rate reached 91.1% and the information transfer rate was 85.80 bit/min.
Published in: IEEE Transactions on Cognitive and Developmental Systems ( Volume: 10, Issue: 3, September 2018)
Funding Agency:
College of Computer and Control Engineering, Nankai University, Tianjin, China
Wenyu Li received the B.S. degree in intelligence science and technology from Nankai University, Tianjin, China, in 2013, where he is currently pursuing the Ph.D. degree with the College of Computer and Control Engineering.
His current research interests include image processing, machine learning, and artificial intelligence.
Mr. Li took part in the RoboCup Japan Open Competition as a Team Member of KameRider and awarded th...Show More
Wenyu Li received the B.S. degree in intelligence science and technology from Nankai University, Tianjin, China, in 2013, where he is currently pursuing the Ph.D. degree with the College of Computer and Control Engineering.
His current research interests include image processing, machine learning, and artificial intelligence.
Mr. Li took part in the RoboCup Japan Open Competition as a Team Member of KameRider and awarded th...View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Feng Duan (M’15) received the B.S. and M.S. degrees in mechanical engineering from Tianjin University, Tianjin, China, in 2002 and 2004, respectively, and the M.S. and Ph.D. degrees in precision engineering from the University of Tokyo, Tokyo, Japan, in 2006 and 2009, respectively.
He is currently a Professor with the College of Computer and Control Engineering, Nankai University, Tianjin. His current research interests in...Show More
Feng Duan (M’15) received the B.S. and M.S. degrees in mechanical engineering from Tianjin University, Tianjin, China, in 2002 and 2004, respectively, and the M.S. and Ph.D. degrees in precision engineering from the University of Tokyo, Tokyo, Japan, in 2006 and 2009, respectively.
He is currently a Professor with the College of Computer and Control Engineering, Nankai University, Tianjin. His current research interests in...View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Shili Sheng (S’17) received the B.E. degree in automation from Nankai University, Tianjin, China, in 2014, where he is currently pursuing the postgraduate degree with the College of Computer and Control Engineering.
He has published several papers in the IEEE conferences. His current research interests include signal processing, brain–computer interface, functional magnetic resonance imaging, and machine learning.
Shili Sheng (S’17) received the B.E. degree in automation from Nankai University, Tianjin, China, in 2014, where he is currently pursuing the postgraduate degree with the College of Computer and Control Engineering.
He has published several papers in the IEEE conferences. His current research interests include signal processing, brain–computer interface, functional magnetic resonance imaging, and machine learning.View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Chengguang Xu received the B.S. degree in automation from Nankai University, Tianjin, China, in 2010, where he is currently pursuing the master’s degree in control science and engineering with the Intelligence and Interaction Laboratory.
His current research interests include the computer vision, which focuses on the basic image processing and the application on the home service robots, and machine learning and its combina...Show More
Chengguang Xu received the B.S. degree in automation from Nankai University, Tianjin, China, in 2010, where he is currently pursuing the master’s degree in control science and engineering with the Intelligence and Interaction Laboratory.
His current research interests include the computer vision, which focuses on the basic image processing and the application on the home service robots, and machine learning and its combina...View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Rensong Liu was born in Qingdao, China, in 1986. He received the B.S. degree in mechanical engineering from Dezhou University, Dezhou, China, in 2010 and the M.S. degree in automation from Qingdao University, Qingdao, China, in 2013. He is currently pursuing the Ph.D. degree in computer and control engineering with Nankai University, Tianjin, China.
He is an Assistant with the College of Computer and Control Engineering, N...Show More
Rensong Liu was born in Qingdao, China, in 1986. He received the B.S. degree in mechanical engineering from Dezhou University, Dezhou, China, in 2010 and the M.S. degree in automation from Qingdao University, Qingdao, China, in 2013. He is currently pursuing the Ph.D. degree in computer and control engineering with Nankai University, Tianjin, China.
He is an Assistant with the College of Computer and Control Engineering, N...View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Zhiwen Zhang received the B.S. degree in intelligence science and technology from Nankai University, Tianjin, China, in 2016, where he is currently pursuing the master’s degree with the College of Computer and Control Engineering.
His current research interests include EEG signal processing and robot research.
Zhiwen Zhang received the B.S. degree in intelligence science and technology from Nankai University, Tianjin, China, in 2016, where he is currently pursuing the master’s degree with the College of Computer and Control Engineering.
His current research interests include EEG signal processing and robot research.View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Xue Jiang received the B.S. degree in information and computing science from the Tianjin University of Technology, Tianjin, China, in 2013. She is currently pursuing the Ph.D. degree with the College of Computer and Control Engineering, Nankai University, Tianjin.
Her current research interests include bioinformatics, machine learning, and data mining.
Xue Jiang received the B.S. degree in information and computing science from the Tianjin University of Technology, Tianjin, China, in 2013. She is currently pursuing the Ph.D. degree with the College of Computer and Control Engineering, Nankai University, Tianjin.
Her current research interests include bioinformatics, machine learning, and data mining.View more
Contents College of Computer and Control Engineering, Nankai University, Tianjin, China
Wenyu Li received the B.S. degree in intelligence science and technology from Nankai University, Tianjin, China, in 2013, where he is currently pursuing the Ph.D. degree with the College of Computer and Control Engineering.
His current research interests include image processing, machine learning, and artificial intelligence.
Mr. Li took part in the RoboCup Japan Open Competition as a Team Member of KameRider and awarded the Second Place in the RoboCup@Home simulation in 2014, and the First Prize in the SPL and the Third Place in the RoboCup@Home simulation in 2015. He also joined world RoboCup@Home league and awarded the Seventh Place in the final competition in 2015.
Wenyu Li received the B.S. degree in intelligence science and technology from Nankai University, Tianjin, China, in 2013, where he is currently pursuing the Ph.D. degree with the College of Computer and Control Engineering.
His current research interests include image processing, machine learning, and artificial intelligence.
Mr. Li took part in the RoboCup Japan Open Competition as a Team Member of KameRider and awarded the Second Place in the RoboCup@Home simulation in 2014, and the First Prize in the SPL and the Third Place in the RoboCup@Home simulation in 2015. He also joined world RoboCup@Home league and awarded the Seventh Place in the final competition in 2015.View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Feng Duan (M’15) received the B.S. and M.S. degrees in mechanical engineering from Tianjin University, Tianjin, China, in 2002 and 2004, respectively, and the M.S. and Ph.D. degrees in precision engineering from the University of Tokyo, Tokyo, Japan, in 2006 and 2009, respectively.
He is currently a Professor with the College of Computer and Control Engineering, Nankai University, Tianjin. His current research interests include cellular manufacturing, human skill, and image processing.
Feng Duan (M’15) received the B.S. and M.S. degrees in mechanical engineering from Tianjin University, Tianjin, China, in 2002 and 2004, respectively, and the M.S. and Ph.D. degrees in precision engineering from the University of Tokyo, Tokyo, Japan, in 2006 and 2009, respectively.
He is currently a Professor with the College of Computer and Control Engineering, Nankai University, Tianjin. His current research interests include cellular manufacturing, human skill, and image processing.View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Shili Sheng (S’17) received the B.E. degree in automation from Nankai University, Tianjin, China, in 2014, where he is currently pursuing the postgraduate degree with the College of Computer and Control Engineering.
He has published several papers in the IEEE conferences. His current research interests include signal processing, brain–computer interface, functional magnetic resonance imaging, and machine learning.
Shili Sheng (S’17) received the B.E. degree in automation from Nankai University, Tianjin, China, in 2014, where he is currently pursuing the postgraduate degree with the College of Computer and Control Engineering.
He has published several papers in the IEEE conferences. His current research interests include signal processing, brain–computer interface, functional magnetic resonance imaging, and machine learning.View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Chengguang Xu received the B.S. degree in automation from Nankai University, Tianjin, China, in 2010, where he is currently pursuing the master’s degree in control science and engineering with the Intelligence and Interaction Laboratory.
His current research interests include the computer vision, which focuses on the basic image processing and the application on the home service robots, and machine learning and its combination with the computer vision.
Mr. Xu joined the RoboCup Japan Open Competition with his team KameRider and awarded the Second Place in the RoboCup@Education league, Nagoya, Japan, in 2016. He joined the 19th RoboCup@Home league with his team KameRider and awarded the Seventh Place in the final competition, Hefei, China, in 2015.
Chengguang Xu received the B.S. degree in automation from Nankai University, Tianjin, China, in 2010, where he is currently pursuing the master’s degree in control science and engineering with the Intelligence and Interaction Laboratory.
His current research interests include the computer vision, which focuses on the basic image processing and the application on the home service robots, and machine learning and its combination with the computer vision.
Mr. Xu joined the RoboCup Japan Open Competition with his team KameRider and awarded the Second Place in the RoboCup@Education league, Nagoya, Japan, in 2016. He joined the 19th RoboCup@Home league with his team KameRider and awarded the Seventh Place in the final competition, Hefei, China, in 2015.View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Rensong Liu was born in Qingdao, China, in 1986. He received the B.S. degree in mechanical engineering from Dezhou University, Dezhou, China, in 2010 and the M.S. degree in automation from Qingdao University, Qingdao, China, in 2013. He is currently pursuing the Ph.D. degree in computer and control engineering with Nankai University, Tianjin, China.
He is an Assistant with the College of Computer and Control Engineering, Nankai University. His current research interests include brain–machine interface-based motor imagery and power-assisted robot.
Mr. Liu instructed undergraduates to participate in research projects of brain–machine interface application and won prizes.
Rensong Liu was born in Qingdao, China, in 1986. He received the B.S. degree in mechanical engineering from Dezhou University, Dezhou, China, in 2010 and the M.S. degree in automation from Qingdao University, Qingdao, China, in 2013. He is currently pursuing the Ph.D. degree in computer and control engineering with Nankai University, Tianjin, China.
He is an Assistant with the College of Computer and Control Engineering, Nankai University. His current research interests include brain–machine interface-based motor imagery and power-assisted robot.
Mr. Liu instructed undergraduates to participate in research projects of brain–machine interface application and won prizes.View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Zhiwen Zhang received the B.S. degree in intelligence science and technology from Nankai University, Tianjin, China, in 2016, where he is currently pursuing the master’s degree with the College of Computer and Control Engineering.
His current research interests include EEG signal processing and robot research.
Zhiwen Zhang received the B.S. degree in intelligence science and technology from Nankai University, Tianjin, China, in 2016, where he is currently pursuing the master’s degree with the College of Computer and Control Engineering.
His current research interests include EEG signal processing and robot research.View more
College of Computer and Control Engineering, Nankai University, Tianjin, China
Xue Jiang received the B.S. degree in information and computing science from the Tianjin University of Technology, Tianjin, China, in 2013. She is currently pursuing the Ph.D. degree with the College of Computer and Control Engineering, Nankai University, Tianjin.
Her current research interests include bioinformatics, machine learning, and data mining.
Xue Jiang received the B.S. degree in information and computing science from the Tianjin University of Technology, Tianjin, China, in 2013. She is currently pursuing the Ph.D. degree with the College of Computer and Control Engineering, Nankai University, Tianjin.
Her current research interests include bioinformatics, machine learning, and data mining.View more
