Developing Evaluation Criteria for Engineering Training Programs in Remote Medical Education in Asia

We developed evaluation criteria for engineer training for international remote medical education with the Asia-Pacific Advanced Network Medical Working Group. A four-level analytic rubric was created for each objective of a previously developed training program. Level 1 was the lowest (incapable) and level 4 the highest (highly capable). We set level 3 (capable) as the attainment target for the training program. We applied the Delphi method for consensus building. The average response rate was 92% (first survey, 16/18; second survey, 17/18). Overall, appropriate consensus was achieved with all the objective items. The evaluation criteria were created following agreement among 17 evaluators from 13 countries and territories. In future research, it will be necessary to evaluate our criteria when assessing participants' achievement levels in actual training.