A Method to Evaluate Binary Code Comparison Tools

Binary code comparison tools are widely used to analyze vulnerabilities, search for malicious code, detect copyright violations, etc. The article discusses three tools - BCC, BinDiff, Diaphora. Those are based on static analysis of programs. The tools receive as input data two versions of the program in binary form and match their functions. The purpose of the article is to assess the quality of the tools. We developed a testing system to automatically determine the precision and recall of each instrument. F1 score on the developed testing system for BCC instrument is 85.6%, for BinDiff - 82.4%, for Diaphora - 64.7%.