Driver Behavior Modeling Using Game Engine and Real Vehicle: A Learning-Based Approach | IEEE Journals & Magazine | IEEE Xplore

Driver Behavior Modeling Using Game Engine and Real Vehicle: A Learning-Based Approach


Abstract:

As a good example of Advanced Driver-Assistance Systems (ADAS), Advisory Speed Assistance (ASA) helps improve driving safety and possibly energy efficiency by showing adv...Show More

Abstract:

As a good example of Advanced Driver-Assistance Systems (ADAS), Advisory Speed Assistance (ASA) helps improve driving safety and possibly energy efficiency by showing advisory speed to the driver of an intelligent vehicle. However, driver-based speed tracking errors often emerge, due to the perception and reaction delay, as well as imperfect vehicle control, degrading the effectiveness of ASA system. In this study, we propose a learning-based approach to modeling driver behavior, aiming to predict and compensate for the speed tracking errors in real time. Subject drivers are first classified into different types according to their driving behaviors using the k-nearest neighbors (k-NN) algorithm. A nonlinear autoregressive (NAR) neural network is then adopted to predict the speed tracking errors generated by each driver. A specific traffic scenario has been created in a Unity game engine-based driving simulator platform, where ASA system provides advisory driving speed to the driver via a head-up display (HUD). A human-in-the-loop simulation study is conducted by 17 volunteer drivers, revealing a 53% reduction in the speed error variance and a 3% reduction in the energy consumption with the compensation of the speed tracking errors. The results are further validated by a field implementation with a real passenger vehicle.
Published in: IEEE Transactions on Intelligent Vehicles ( Volume: 5, Issue: 4, December 2020)
Page(s): 738 - 749
Date of Publication: 01 May 2020

ISSN Information:

Funding Agency:

Author image of Ziran Wang
InfoTech Labs, Toyota Motor North America, Mountain View, CA, USA
Ziran Wang (Member, IEEE) received the Ph.D. degree in mechanical engineering from the University of California at Riverside in 2019, and the B.E. degree in mechanical engineering and automation from Beijing University of Posts and Telecommunications in 2015, respectively. He is currently a Research Scientist at Toyota Motor North America R&D, InfoTech Labs. His research focuses on cooperative automation and digital twin ...Show More
Ziran Wang (Member, IEEE) received the Ph.D. degree in mechanical engineering from the University of California at Riverside in 2019, and the B.E. degree in mechanical engineering and automation from Beijing University of Posts and Telecommunications in 2015, respectively. He is currently a Research Scientist at Toyota Motor North America R&D, InfoTech Labs. His research focuses on cooperative automation and digital twin ...View more
Author image of Xishun Liao
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
Xishun Liao (Student Member, IEEE) received the B.E. degree in mechanical engineering and automation from the Beijing University of Posts and Telecommunications in 2016, and the M.Eng. degree in mechanical engineering from University of Maryland, College Park in 2018. He is currently a Ph.D. Student in electrical and computer engineering atthe University of California at Riverside. His research focuses on connected and au...Show More
Xishun Liao (Student Member, IEEE) received the B.E. degree in mechanical engineering and automation from the Beijing University of Posts and Telecommunications in 2016, and the M.Eng. degree in mechanical engineering from University of Maryland, College Park in 2018. He is currently a Ph.D. Student in electrical and computer engineering atthe University of California at Riverside. His research focuses on connected and au...View more
Author image of Chao Wang
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
Chao Wang (Student Member, IEEE) received the B.S. degree in electrical engineering from the Huazhong University of Science and Technology in 2015. He is currently a Ph.D. Candidate in electrical engineering at the University of California at Riverside. His research interests include urban computing, crowdsourced transportation data mining, sharing mobility, connected and automated vehicles, machine learning and deep lear...Show More
Chao Wang (Student Member, IEEE) received the B.S. degree in electrical engineering from the Huazhong University of Science and Technology in 2015. He is currently a Ph.D. Candidate in electrical engineering at the University of California at Riverside. His research interests include urban computing, crowdsourced transportation data mining, sharing mobility, connected and automated vehicles, machine learning and deep lear...View more
Author image of David Oswald
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
David Oswald received the B.S. degrees in mathematics and computer engineering from the California State University Bakersfield in 2013, and the M.S. degree in electrical engineering from the California State University Northridge in 2017. He is currently pursuing the Ph.D. in electrical engineering from the University of California at Riverside, Riverside. His current research involves connected and automated vehicles.
David Oswald received the B.S. degrees in mathematics and computer engineering from the California State University Bakersfield in 2013, and the M.S. degree in electrical engineering from the California State University Northridge in 2017. He is currently pursuing the Ph.D. in electrical engineering from the University of California at Riverside, Riverside. His current research involves connected and automated vehicles.View more
Author image of Guoyuan Wu
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
Guoyuan Wu (Senior Member, IEEE) received the Ph.D. degree in mechanical engineering from the University of California at Berkeley in 2010. He is currently an Associate Research Engineer with the Transportation Systems Research Group, Center for Environmental Research and Technology, Bourns College of Engineering, University of California, Riverside, USA. Dr. His research focuses on intelligent and sustainable transportat...Show More
Guoyuan Wu (Senior Member, IEEE) received the Ph.D. degree in mechanical engineering from the University of California at Berkeley in 2010. He is currently an Associate Research Engineer with the Transportation Systems Research Group, Center for Environmental Research and Technology, Bourns College of Engineering, University of California, Riverside, USA. Dr. His research focuses on intelligent and sustainable transportat...View more
Author image of Kanok Boriboonsomsin
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
Kanok Boriboonsimsin (Member, IEEE) received the Ph.D. degree in transportation engineering from the University of Mississippi in 2004. He is currently a Research Engineer with the Center for Environmental Research and Technology, College of Engineering, University of California at Riverside. His research interests include sustainable transportation systems and technologies, intelligent transportation systems, traffic sim...Show More
Kanok Boriboonsimsin (Member, IEEE) received the Ph.D. degree in transportation engineering from the University of Mississippi in 2004. He is currently a Research Engineer with the Center for Environmental Research and Technology, College of Engineering, University of California at Riverside. His research interests include sustainable transportation systems and technologies, intelligent transportation systems, traffic sim...View more
Author image of Matthew J. Barth
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
Matthew J. Barth (Fellow, IEEE) received the M.S. and Ph.D degree in electrical and computer engineering from the University of California at Santa Barbara, in 1985 and 1990, respectively. He is currently the Yeager Families Professor with the College of Engineering, University of California at Riverside, USA. He is also serving as the Director for the Center for Environmental Research and Technology. His current research...Show More
Matthew J. Barth (Fellow, IEEE) received the M.S. and Ph.D degree in electrical and computer engineering from the University of California at Santa Barbara, in 1985 and 1990, respectively. He is currently the Yeager Families Professor with the College of Engineering, University of California at Riverside, USA. He is also serving as the Director for the Center for Environmental Research and Technology. His current research...View more
Author image of Kyungtae Han
InfoTech Labs, Toyota Motor North America, Mountain View, CA, USA
Kyungtae Han (Senior Member, IEEE) received the Ph.D. degree in electrical and computer engineering from The University of Texas at Austin in 2006. He is currently a Principal Researcher at Toyota Motor North America, InfoTech Labs. Prior to joining Toyota, Dr. Han was a Research Scientist at Intel Labs, and a Director in Locix Inc. His research interests include cyber-physical systems, connected and automated vehicle tec...Show More
Kyungtae Han (Senior Member, IEEE) received the Ph.D. degree in electrical and computer engineering from The University of Texas at Austin in 2006. He is currently a Principal Researcher at Toyota Motor North America, InfoTech Labs. Prior to joining Toyota, Dr. Han was a Research Scientist at Intel Labs, and a Director in Locix Inc. His research interests include cyber-physical systems, connected and automated vehicle tec...View more
Author image of BaekGyu Kim
InfoTech Labs, Toyota Motor North America, Mountain View, CA, USA
BaekGyu Kim (Member, IEEE) received the Ph.D. degree in computer and information science from the University of Pennsylvania in 2015. He is currently a Principal Researcher at Toyota Motor North America, InfoTech Labs. His research interests include modeling, verification, code generation and model-based testing for high-assurance systems.
BaekGyu Kim (Member, IEEE) received the Ph.D. degree in computer and information science from the University of Pennsylvania in 2015. He is currently a Principal Researcher at Toyota Motor North America, InfoTech Labs. His research interests include modeling, verification, code generation and model-based testing for high-assurance systems.View more
Author image of Prashant Tiwari
InfoTech Labs, Toyota Motor North America, Mountain View, CA, USA
Prashant Tiwari received the Ph.D. degree in mechanical engineering from Rensselaer Polytechnic Institute in 2004, and the MBA degree from University of Chicago in 2016. He is currently an Executive Director at Toyota Motor North America, InfoTech Labs. Dr. Tiwari is highly active in Automotive Edge Computing Consortium (AECC) and SAE. Prior to joining Toyota, Dr. Tiwari held several leadership positions of increasing res...Show More
Prashant Tiwari received the Ph.D. degree in mechanical engineering from Rensselaer Polytechnic Institute in 2004, and the MBA degree from University of Chicago in 2016. He is currently an Executive Director at Toyota Motor North America, InfoTech Labs. Dr. Tiwari is highly active in Automotive Edge Computing Consortium (AECC) and SAE. Prior to joining Toyota, Dr. Tiwari held several leadership positions of increasing res...View more

Author image of Ziran Wang
InfoTech Labs, Toyota Motor North America, Mountain View, CA, USA
Ziran Wang (Member, IEEE) received the Ph.D. degree in mechanical engineering from the University of California at Riverside in 2019, and the B.E. degree in mechanical engineering and automation from Beijing University of Posts and Telecommunications in 2015, respectively. He is currently a Research Scientist at Toyota Motor North America R&D, InfoTech Labs. His research focuses on cooperative automation and digital twin of intelligent vehicles.
Ziran Wang (Member, IEEE) received the Ph.D. degree in mechanical engineering from the University of California at Riverside in 2019, and the B.E. degree in mechanical engineering and automation from Beijing University of Posts and Telecommunications in 2015, respectively. He is currently a Research Scientist at Toyota Motor North America R&D, InfoTech Labs. His research focuses on cooperative automation and digital twin of intelligent vehicles.View more
Author image of Xishun Liao
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
Xishun Liao (Student Member, IEEE) received the B.E. degree in mechanical engineering and automation from the Beijing University of Posts and Telecommunications in 2016, and the M.Eng. degree in mechanical engineering from University of Maryland, College Park in 2018. He is currently a Ph.D. Student in electrical and computer engineering atthe University of California at Riverside. His research focuses on connected and automated vehicle technology.
Xishun Liao (Student Member, IEEE) received the B.E. degree in mechanical engineering and automation from the Beijing University of Posts and Telecommunications in 2016, and the M.Eng. degree in mechanical engineering from University of Maryland, College Park in 2018. He is currently a Ph.D. Student in electrical and computer engineering atthe University of California at Riverside. His research focuses on connected and automated vehicle technology.View more
Author image of Chao Wang
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
Chao Wang (Student Member, IEEE) received the B.S. degree in electrical engineering from the Huazhong University of Science and Technology in 2015. He is currently a Ph.D. Candidate in electrical engineering at the University of California at Riverside. His research interests include urban computing, crowdsourced transportation data mining, sharing mobility, connected and automated vehicles, machine learning and deep learning, eco-approach and departure, signal control and traffic operations.
Chao Wang (Student Member, IEEE) received the B.S. degree in electrical engineering from the Huazhong University of Science and Technology in 2015. He is currently a Ph.D. Candidate in electrical engineering at the University of California at Riverside. His research interests include urban computing, crowdsourced transportation data mining, sharing mobility, connected and automated vehicles, machine learning and deep learning, eco-approach and departure, signal control and traffic operations.View more
Author image of David Oswald
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
David Oswald received the B.S. degrees in mathematics and computer engineering from the California State University Bakersfield in 2013, and the M.S. degree in electrical engineering from the California State University Northridge in 2017. He is currently pursuing the Ph.D. in electrical engineering from the University of California at Riverside, Riverside. His current research involves connected and automated vehicles.
David Oswald received the B.S. degrees in mathematics and computer engineering from the California State University Bakersfield in 2013, and the M.S. degree in electrical engineering from the California State University Northridge in 2017. He is currently pursuing the Ph.D. in electrical engineering from the University of California at Riverside, Riverside. His current research involves connected and automated vehicles.View more
Author image of Guoyuan Wu
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
Guoyuan Wu (Senior Member, IEEE) received the Ph.D. degree in mechanical engineering from the University of California at Berkeley in 2010. He is currently an Associate Research Engineer with the Transportation Systems Research Group, Center for Environmental Research and Technology, Bourns College of Engineering, University of California, Riverside, USA. Dr. His research focuses on intelligent and sustainable transportation system technologies, optimization and control of transportation systems, and traffic simulation.
Guoyuan Wu (Senior Member, IEEE) received the Ph.D. degree in mechanical engineering from the University of California at Berkeley in 2010. He is currently an Associate Research Engineer with the Transportation Systems Research Group, Center for Environmental Research and Technology, Bourns College of Engineering, University of California, Riverside, USA. Dr. His research focuses on intelligent and sustainable transportation system technologies, optimization and control of transportation systems, and traffic simulation.View more
Author image of Kanok Boriboonsomsin
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
Kanok Boriboonsimsin (Member, IEEE) received the Ph.D. degree in transportation engineering from the University of Mississippi in 2004. He is currently a Research Engineer with the Center for Environmental Research and Technology, College of Engineering, University of California at Riverside. His research interests include sustainable transportation systems and technologies, intelligent transportation systems, traffic simulation, traffic operations, transportation modeling, vehicle emissions modeling, and vehicle activity analysis.
Kanok Boriboonsimsin (Member, IEEE) received the Ph.D. degree in transportation engineering from the University of Mississippi in 2004. He is currently a Research Engineer with the Center for Environmental Research and Technology, College of Engineering, University of California at Riverside. His research interests include sustainable transportation systems and technologies, intelligent transportation systems, traffic simulation, traffic operations, transportation modeling, vehicle emissions modeling, and vehicle activity analysis.View more
Author image of Matthew J. Barth
Center for Environmental Research and Technology, University of California Riverside, Riverside, CA, USA
Matthew J. Barth (Fellow, IEEE) received the M.S. and Ph.D degree in electrical and computer engineering from the University of California at Santa Barbara, in 1985 and 1990, respectively. He is currently the Yeager Families Professor with the College of Engineering, University of California at Riverside, USA. He is also serving as the Director for the Center for Environmental Research and Technology. His current research interests include ITS and the environment, transportation/emissions modeling, vehicle activity analysis, advanced navigation techniques, electric vehicle technology, and advanced sensing and control. Dr. Barth has been active in the IEEE Intelligent Transportation System Society for many years, serving as Senior Editor for both the Transactions of ITS and the IEEE Transactions on Intelligent Vehicles. He served as the IEEE ITSS President for 2014 and 2015 and is currently the IEEE ITSS Vice President for Finance.
Matthew J. Barth (Fellow, IEEE) received the M.S. and Ph.D degree in electrical and computer engineering from the University of California at Santa Barbara, in 1985 and 1990, respectively. He is currently the Yeager Families Professor with the College of Engineering, University of California at Riverside, USA. He is also serving as the Director for the Center for Environmental Research and Technology. His current research interests include ITS and the environment, transportation/emissions modeling, vehicle activity analysis, advanced navigation techniques, electric vehicle technology, and advanced sensing and control. Dr. Barth has been active in the IEEE Intelligent Transportation System Society for many years, serving as Senior Editor for both the Transactions of ITS and the IEEE Transactions on Intelligent Vehicles. He served as the IEEE ITSS President for 2014 and 2015 and is currently the IEEE ITSS Vice President for Finance.View more
Author image of Kyungtae Han
InfoTech Labs, Toyota Motor North America, Mountain View, CA, USA
Kyungtae Han (Senior Member, IEEE) received the Ph.D. degree in electrical and computer engineering from The University of Texas at Austin in 2006. He is currently a Principal Researcher at Toyota Motor North America, InfoTech Labs. Prior to joining Toyota, Dr. Han was a Research Scientist at Intel Labs, and a Director in Locix Inc. His research interests include cyber-physical systems, connected and automated vehicle technique, and intelligent transportation systems.
Kyungtae Han (Senior Member, IEEE) received the Ph.D. degree in electrical and computer engineering from The University of Texas at Austin in 2006. He is currently a Principal Researcher at Toyota Motor North America, InfoTech Labs. Prior to joining Toyota, Dr. Han was a Research Scientist at Intel Labs, and a Director in Locix Inc. His research interests include cyber-physical systems, connected and automated vehicle technique, and intelligent transportation systems.View more
Author image of BaekGyu Kim
InfoTech Labs, Toyota Motor North America, Mountain View, CA, USA
BaekGyu Kim (Member, IEEE) received the Ph.D. degree in computer and information science from the University of Pennsylvania in 2015. He is currently a Principal Researcher at Toyota Motor North America, InfoTech Labs. His research interests include modeling, verification, code generation and model-based testing for high-assurance systems.
BaekGyu Kim (Member, IEEE) received the Ph.D. degree in computer and information science from the University of Pennsylvania in 2015. He is currently a Principal Researcher at Toyota Motor North America, InfoTech Labs. His research interests include modeling, verification, code generation and model-based testing for high-assurance systems.View more
Author image of Prashant Tiwari
InfoTech Labs, Toyota Motor North America, Mountain View, CA, USA
Prashant Tiwari received the Ph.D. degree in mechanical engineering from Rensselaer Polytechnic Institute in 2004, and the MBA degree from University of Chicago in 2016. He is currently an Executive Director at Toyota Motor North America, InfoTech Labs. Dr. Tiwari is highly active in Automotive Edge Computing Consortium (AECC) and SAE. Prior to joining Toyota, Dr. Tiwari held several leadership positions of increasing responsibilities at GE and UTC Aerospace Systems.
Prashant Tiwari received the Ph.D. degree in mechanical engineering from Rensselaer Polytechnic Institute in 2004, and the MBA degree from University of Chicago in 2016. He is currently an Executive Director at Toyota Motor North America, InfoTech Labs. Dr. Tiwari is highly active in Automotive Edge Computing Consortium (AECC) and SAE. Prior to joining Toyota, Dr. Tiwari held several leadership positions of increasing responsibilities at GE and UTC Aerospace Systems.View more

Contact IEEE to Subscribe

References

References is not available for this document.