Automated Scenario Generation Using Halton Sequences for the Verification of Autonomous Vehicle Behavior in Simulation
Date of Award
Thesis - Open Access
Master of Science in Mechanical Engineering
Patrick Currier, Ph.D.
First Committee Member
M. Ilhan Akbas, Ph.D.
Second Committee Member
Eric Coyle, Ph.D.
As autonomous vehicles continue to develop, verifying their safety remains a large hurdle to mass adoption. One component of this is testing, however it has been shown that it is impractical to statistically prove an autonomous vehicle’s safety using real-world testing alone. Therefore, simulation tools and other virtual testing methods are being employed to assist with the verification process. Testing in simulation still faces some of the challenges of the real world, such as the difficulty in exhaustively testing the system in all scenarios it will encounter. Manual scenario creation is time consuming and does not guarantee scenario coverage. Pseudo-random scenario generation is a faster option, but still does not ensure coverage of the state space. Therefore, this study proposes the use of Halton sequences to automatically generate scenarios for autonomous vehicle testing in simulation. It compares these scenarios against a set of pseudo-randomly generated scenarios and assesses the performance of each method to cover the simulation state space and provide an accurate depiction of the capabilities of the system-under-test. These tests are carried out in the CARLA simulation environment on an open source, published driving model called “Learning by Cheating” which takes place as the system-under-test. This study concludes that the scenario set generated by the Halton sequence is better at providing an accurate representation of the capabilities of the system-under-test than the pseudo-random scenario generation method.
Scholarly Commons Citation
Ferree, Andrew, "Automated Scenario Generation Using Halton Sequences for the Verification of Autonomous Vehicle Behavior in Simulation" (2021). Doctoral Dissertations and Master's Theses. 591.