Date of Award

Spring 4-10-2021

Embargo Period

5-1-2022

Access Type

Thesis - Open Access

Degree Name

Master of Science in Mechanical Engineering

Department

Mechanical Engineering

Committee Chair

Patrick Currier

First Committee Member

M. Ilhan Akbas

Second Committee Member

Eric Coyle

Abstract

As autonomous vehicles continue to develop, verifying their safety remains a large hurdle to mass adoption. One component of this is testing, however it has been shown that it is impractical to statistically prove an autonomous vehicle’s safety using real-world testing alone. Therefore, simulation tools and other virtual testing methods are being employed to assist with the verification process. Testing in simulation still faces some of the challenges of the real world, such as the difficulty in exhaustively testing the system in all scenarios it will encounter. Manual scenario creation is time consuming and does not guarantee scenario coverage. Pseudo-random scenario generation is a faster option, but still does not ensure coverage of the state space. Therefore, this study proposes the use of Halton sequences to automatically generate scenarios for autonomous vehicle testing in simulation. It compares these scenarios against a set of pseudo-randomly generated scenarios and assesses the performance of each method to cover the simulation state space and provide an accurate depiction of the capabilities of the system-under-test. These tests are carried out in the CARLA simulation environment on an open source, published driving model called “Learning by Cheating” which takes place as the system-under-test. This study concludes that the scenario set generated by the Halton sequence is better at providing an accurate representation of the capabilities of the system-under-test than the pseudo-random scenario generation method.

Download

Share

COinS