Failure diagnosis using decision trees
Chen, M.
Zheng, A.X.
Lloyd, J.
Jordan, M.I.
Brewer, E.
California Univ., Berkeley, CA, USA;
This paper appears in: Autonomic Computing, 2004. Proceedings. International Conference on
Publication Date: 17-18 May 2004
On page(s): 36- 43
ISSN:
ISBN: 0-7695-2114-2
INSPEC Accession Number: 8047782
Digital Object Identifier: 10.1109/ICAC.2004.1301345
Current Version Published: 2004-06-01
Abstract
We present a decision tree learning approach to diagnosing failures in large Internet sites. We record runtime properties of each request and apply automated machine learning and data mining techniques to identify the causes of failures. We train decision trees on the request traces from time periods in which user-visible failures are present. Paths through the tree are ranked according to their degree of correlation with failure, and nodes are merged according to the observed partial order of system components. We evaluate this approach using actual failures from eBay, and find that, among hundreds of potential causes, the algorithm successfully identifies 13 out of 14 true causes of failure, along with 2 false positives. We discuss some results in applying simplified decision trees on eBay's production site for several months. In addition, we give a cost-benefit analysis of manual vs. automated diagnosis systems. Our contributions include the statistical learning approach, the adaptation of decision trees to the context of failure diagnosis, and the deployment and evaluation of our tools on a high-volume production service.
Index
Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.
Cart
