On the Automatic Assessment of Learning Outcome in Programming Techniques

With the introduction of digital media and the rapid spreading of the digitalization process in our society, there is an increased need in the use of online methods for the automatic evaluation of learning outcomes. Such kinds of electronic assessments (abbr. E-Assessment) are of particular importance in the areas of science and engineering education, where students have to learn and exercise on programming techniques. In this work, we have reviewed and analyzed existing approaches aiming at automatic verification of computer programs for teaching and learning purposes. Based on the capabilities and characteristics of these systems, they have been clustered into three categories. After the study of the strengths and limitations of these approaches, we put forward our view on several aspects which are relevant for an E-Assessment system. Our further contribution lies in the discussion of relevant research questions as well as the potential impacts of E-Assessment in future academic teaching.