AstroBug: Automatic Game Bug Detection Using Deep Learning

Traditional methods of video game bug detection, such as manual testing, have been effective, but they can also be time-consuming and costly. While Automated Bug Detection (ABD) techniques hold great promise for improving testing, they still face several challenges that need to be addressed to be effective in practice. In this work, we introduce a new framework to detect perceptual bugs using a Long Short-Term Memory (LSTM) network, which detects bugs in games as anomalies. The detected buggy frames are then clustered to determine the category of the occurred bug. The framework was evaluated on two First Person Shooter (FPS) games. We further enhanced the framework by implementing a Reinforcement Learning (RL) agent to autonomously gather datasets, effectively addressing the need for human players to collect data and manually browse through games. The enhancement was performed on a Role-Playing Game (RPG). The outcomes obtained validate the effectiveness of the framework.