Evaluating the effect of different teamwork training interventions on the quality of peer evaluations

This research-to-practice paper describes the results of 12 experiments using different combinations of peer evaluation trainings on the quality of peer evaluations of teamwork skills provided by first year engineering (FYE) students in an introduction to engineering course in a large Midwestern University. Our research question was: Which combination of peer evaluation trainings most significantly improves the quality of peer evaluations in this FYE course as measured by using data collected by the CATME (Comprehensive Assessment of Team Member Effectiveness) system's peer evaluation exercise? The five training interventions combined in the 12 experiments were Frame-of-reference teamwork training, Video-based teamwork training materials, Rater practice, Rater accuracy training and In-class teamwork reflections. The training intervention combinations that included Video based training and Rater accuracy training had the most significant effects on improving rater and target variances or the quality of peer evaluations.