Continuous Analysis of Assignment Evaluation Results from Automated Testing Platform in Iterative-Style Programming Courses

This paper presents a proposal of usage continuous analysis of assignment evaluation results in a real programming course with 585 students to improve syllabus and teacher adaptation. The use of Elastic Stack has proven to be a convenient solution in terms of both efficiency and cost. At the same time the article answers important questions about the attitude of students in such courses. It was found that the structure and compilation issues persist during the whole course, the failure of the first assignment demotivates the student in solving following tasks and the number of students with the highest grades decreases. An important result is that students have only used 10% of the evaluation possibilities on average and work mostly on weekends and in the evenings. At the same time an increased number of above-average results was observed while using the same assignments as in previous course runs.