By Topic

Online formative assessment using automated essay scoring technology in China and U.S.— Two case studies

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Changhua Sun Rich ; CTB/McGraw-Hill, 20 Ryan Ranch Road, Monterey, CA 93940, USA ; Yihong Wang

Automated essay scoring (AES) has benefits such as time saving for teachers, immediate diagnostic feedback and reliable score reporting. This paper reports two case studies of using online automated essay scoring technology as formative assessment tool in the Chinese and the U.S. classrooms. In the first case study, we report how Writing Roadmap 2.0 (WRM 2.0), an online formative assessment tool, is integrated in the West Virginia classrooms, U.S.A. In the second case study, we summarize a pilot study on Writing Roadmap 2.0 use in the English writing classrooms in Beijing. We present two-year empirical data from the state of West Virginia online writing assessments to exam the effects of classroom formative assessment using Writing Roadmap 2.0 AES program on the state summative writing assessment scores. Consistent and statistically significant positive mean score differences on the state summative writing test were found for students practiced using WRM 2.0 software compared to students who did not practice. The largest score gain was found for low performing students who practiced 4 or more times compared to no practice students from the same performance level. In the case study in Beijing China Foreign Affairs University (CFAU), we found that the AI-scoring writing program alone is not sufficient for improving student writing. EFL English teachers need professional development to integrate online formative assessment in teaching. Teachers and students experience role changing when AI essay scoring software is used in the classroom. Understanding the online writing score feedback and transforming the immediate score data information to actions is the key to success.

Published in:

2010 2nd International Conference on Education Technology and Computer  (Volume:3 )

Date of Conference:

22-24 June 2010