Poster: Enabling Comparable and Reproducible Simulations for V2X Research

Simulations are a prime performance evaluation technique for new Vehicle to Everything (V2X) methods and approaches. However, after decades of simulation-backed research, comparability and reproducibility of simulation studies is still low. In this work, we first survey road traffic simulation parameters (that is, scenarios) employed in recent scientific publications, revealing that many publications still do not adequately describe simulation scenarios to make the results comprehensible. As just one example, over 40% of the simulations using either a Manhattan Grid or Chicago Grid do not provide information about the number of lanes. At the same time, our survey reveals that, even though employed road traffic scenarios are very use case specific, there exist many commonalities. We therefore advocate basing research on use case specific variants of a set of these common standard road traffic scenarios. We accompany this recommendation with Simple Synthetic Scenarios for Sumo (sss4s), a simple reference implementation to generate such variants.