Better Safe Than Sorry – an Evaluation Framework for Simulation-Based Theory Construction

Simulation constitutes a fundamental methodology that is commonly used to analyze the dynamic and emergent behaviors of complex systems. To increase faith in simulation-based theory-building, research needs to be able to demonstrate and evaluate its validity by means of true findings and correct recommendations. However, simulation credibility is pluralist, which means there are different forms of validity depending on context and domain. Hence, based on a systematic literature analysis, this study seeks to dissect simulation evaluation routines and rationales in scientific research. Having critically synthesized 1,609 articles on simulation-based theory-building, we describe the methods used to evaluate simulations. Finally, based on the literature insights, we compile two evaluation frameworks that enable researchers to plan multifarious evaluation episodes and advance a pluralist approach to simulation evaluation.