Development of a benchmark to measure system robustness
Siewiorek, D.P.; Hudak, J.J.; Suh, B.-H.; Segal, Z.
Fault-Tolerant Computing, 1993. FTCS-23. Digest of Papers., The Twenty-Third International Symposium on
Volume , Issue , 22-24 Jun 1993 Page(s):88 - 97
Digital Object Identifier 10.1109/FTCS.1993.627311
Summary:An initial attempt at the development of a set of benchmarks to
gauge a system's robustness as measured by its ability to tolerate
errors is presented. Due to the large domain of system components whose
intolerance to errors can lead to system failure, several primitive
benchmarks that can be combined into a robustness benchmark suite are
presented. Each primitive benchmark targets a system functionality and
measure its behavior given erroneous inputs. Four primitive benchmarks
have been implemented in this initial effort. They target the file
management system, memory access, user application, and the C library
functions. The motivation and experimental results of each of these
primitive benchmarks are presented in detail followed by an analysis of
the results. A methodology to combine the primitive benchmarks to form
an overall robustness figure is presented. A list of additional
primitive benchmarks is suggested
View citation and abstract |