By Topic

An empirical study comparing pilots' interrater reliability ratings for workload and effectiveness

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Adelman, L. ; Dept. of Inf. Syst. & Syst. Eng., George Mason Univ., Fairfax, VA ; Donnell, M.L.

Pilot workload and technical effectiveness have been considered to be essential criteria when evaluating aircraft operability with subjective rating techniques. However, validation studies of the mission operability assessment technique found considerably higher levels of interrater reliability for pilots' ratings of workload than for technical effectiveness. The finding was replicated across aircraft, pilots, tasks, and with different forms of the rating scales. These results suggest that the implicit assumption that interrater reliability will be high and essentially identical for both pilot workload and technical effectiveness ratings may be invalid. This finding has implications for how one defines and subsequently measures aircraft operability with subjective rating techniques

Published in:

Systems, Man and Cybernetics, IEEE Transactions on  (Volume:18 ,  Issue: 6 )