Performance Efficiency Evaluation Frameworks Based on ISO 25010

The Cucumber Framework and the Mocha Framework are the two popular frameworks in developing automation testing. However, in determining a framework that will be used, the performance becomes a primary consideration in order to maximize the main function of test automation. In this study we assess aspects of performance efficiency in both frameworks based on ISO 25010. This aspect consists of three sub-characteristics, i.e. Time Behavior, Resource Utilization, and Capacity Assessment. To get this assessment, both frameworks implemented 50 test cases and were tested ten times. The results of experiments conducted showed that the Cucumber framework is more efficient in completing its work. But based on the memory and storage needed, the Mocha framework requires less memory and storage than other. Whereas the capacity assessment in both frameworks has the same value.