Issues and methods for evaluating learner-centered scaffolding

Learner-centered design is an evolving design perspective focusing on the design of software scaffolds to support novice learners in using software to do and learn previously unknown work practices. Scaffolding evaluation is necessary to see how well learners can perform new work activity using the scaffolded software. However, scaffolding evaluation is challenging because of the need to address several issues resulting from the interplay between user-centered and learner-centered perspectives. Scaffolding evaluation methods need specific criteria to address learner-centered concerns, traditional usability measures to address user-centered concerns, and considerations of the instances when usability conflicts with the learning goals of scaffolded tools. The authors discuss these learner-centered evaluation issues and a scaffolding evaluation method to assess, not just the usability of the software, but also the effectiveness of the scaffolds in terms of the learning goals behind the software.