How to Measure the Performance of Automated Program Repair

As with the advance of automated program repair, many novel repair approaches have been proposed in recent. There also exist empirical work focusing on the performance comparison among those approaches. In this paper we survey recent repair work in five main venues, and plan to answer the question of how to measure the performance of automated program repair in term of evaluation metrics. We summary the evaluation metrics in literature, and conduct the discussion on how to construct the common metrics for further research in the area of automated program repair.