Results of a Comparative Study of Code Coverage Tools in Computer Vision

The high quality of computer vision (CV) software has a great impact on the usability of the overall CV systems in real world scenarios. As the usage of standardized quality assurance methods, metrics and tools can ease the work of any CV developer and quickly improve the overall process, we report here on the introduction of code coverage analysis in the field. Our initial motivations were both to understand the available test coverage tools and to compare them in order to answer the questions of which test coverage tool to prefer in the area of CV software and whether we can introduce some specific evaluation criteria for identifying the right tool to be used within a CV project. The readers may use this study to help choose the right coverage testing tools for their needs and environment. This article is also valuable to those who are new to the practice and the art of software coverage testing, as it is generally the case for CV people.