ChatGPT on the Freshman Test in C/C++ Programming

We investigate the use of ChatGPT for solving fundamental programming tasks in C/C++ languages and put it on a freshman programming test. The obtained source code was graded rather benevolently, in a way we would grade the code written by our students: functionality first, but then also optimality and form. The test was first given in English, then in Croatian, and after that repeated again in English. ChatGPT passes the exam with very good grades, outperforming most of our students in the quality of solutions. Furthermore, it solves each task within 20 to 30 seconds and shows the general ability to adapt or change its solutions according to additional demands. However, in some, often simple tasks, it showed the inability to comprehend the logical and mathematical essence of the problem, even after being prompted about its errors several times.