An Approach to Pinpointing Bug-Induced Failure in Logs of Open Cloud Platforms

Software bugs have been one of the dominantcauses of system failures, especially in cloud systems basedon open source platforms. One big challenge fortroubleshooting these cloud systems is to pinpoint thesoftware bug-induced failure in large and complex log fileswhich is a nightmare for administrators. So far, there hasbeen little study on how to identity bug-induced failuresbased on log analysis. In this paper, we analyze and describefeatures of bug-induced failure logs from bug repository and Q&A websites, and then propose a general automaticapproach to pinpoint logs of bug-induced failure from logfiles of open cloud platform. In the approach, two algorithmscalled MPIN and SPIN are presented for log classification. We evaluate our approach by applying logs collected frombug repositories of OpenStack and Hadoop, and five Q&A websites. The experimental result shows that the proposedapproach can identify logs of bug-induced failure inOpenStack logs with 83.9% precision, and for Hadoop logswith 82.52% precision.