By Topic

Experimental evaluation of system performance

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $33
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

1 Author(s)

Developers of computer systems are frequently faced with a choice among several possible implementations of a given function. Similary, the operator of a computer system faces a choice in setting adjustable parameters built into the system. In each case, the alternative that optimizes system performance is sought. While analytic or simulation models may sometimes assist in making the choice, it is true that in most cases only actual running tests of the various alternatives can provide definitive answers. But even when all the variations can be tested on a real system, it is not easy to obtain meaningful results. One has the choice between performing the tests on a carefully controlled benchmark job stream, or on the system in an actual uncontrolled working environment. In the first case, the results may be inapplicable except to the specific benchmarks chosen, and a realistic benchmark stream is often hard to come by (this is particularly true for time-sharing or real-time computer systems). In the second case, random fluctuations in the magnitude and nature of the load placed on the system make it difficult to compare the results obtained under different system versions. Consequently, although performance evaluation is still possible, data must be gathered over a fairly long period of time. For instance, different versions of the CP-67 time-sharing system1,2 were compared by Bard3 under actual operating conditions. However, several months' worth of data were required. To meet the objectives outlined above, results must be forthcoming at a faster pace.

Note: The Institute of Electrical and Electronics Engineers, Incorporated is distributing this Article with permission of the International Business Machines Corporation (IBM) who is the exclusive owner. The recipient of this Article may not assign, sublicense, lease, rent or otherwise transfer, reproduce, prepare derivative works, publicly display or perform, or distribute the Article.  

Published in:

IBM Systems Journal  (Volume:12 ,  Issue: 3 )