EvoMaster: Evolutionary Multi-context Automated System Test Generation

This paper presents EVOMASTER, an open-source tool that is able to automatically generate system level test cases using evolutionary algorithms. Currently, EVOMASTER targets RESTful web services running on JVM technology, and has been used to find several faults in existing open-source projects. We discuss some of the architectural decisions made for its implementation, and future work.

I. Introduction

There exist different tools that can automatically generate unit tests, using variants of random testing (e.g., Randoop [1]), evolutionary search (e.g., EvoSuite [2]) or dynamic symbolic execution (e.g., Pex/IntelliTest [3]). For smartphone applications [4], there are tools like Sapienz [5] that can generate sequences of events on the GUI. For web applications serving HTML pages, there are web crawler tools like Crawljax [6]. These crawlers can be used for testing of web applications, but they are black-box, and do not take into account the internal details of the server side code. Furthermore, little exists that is available (i.e., a tool that can be downloaded and used) for white-box system testing of enterprise applications [7], in particular RESTful web services.