Analysis of Algorithm Comparison Results on Real-World Multi-Objective Problems

Recently, several real-world multi-objective optimization problem suites have been proposed to facilitate the evaluation of the performance of evolutionary multi-objective optimization (EMO) algorithms. In spite of the importance of using real-world problems to evaluate EMO algorithms, their characteristics are not well understood compared to artificial test problems. Thus, there is a need to examine and understand the challenges posed by these real-world problems. In this study, we attempt to explore the characteristics of the most recently proposed real-world application suite (i.e., RWA suite). Six EMO algorithms are evaluated on the RWA suite, including three classic algorithms and three recently-proposed algorithms. Based on the performance comparison results, we systematically analyze the RWA suite in terms of convergence and diversity difficulties.