Measuring the Robustness of Alarm Flood Classification Against Alarm Data Quality Issues

Alarm floods remain a challenge in industrial operations, potentially overwhelming human operators with excessive alarm notifications during abnormal situations. To address this, alarm flood classification (AFC) methods utilize historical data to classify recurring alarm patterns automatically. However, the practical utility of these methods may be limited by potential degradation in alarm data quality, resulting from sensor faults, communication errors, or detection delays, which can substantially compromise their classification accuracy and reliability. This paper proposes a novel methodology to systematically analyze the robustness of AFC methods against realistic alarm data quality issues. We introduce four distinct perturbations: missing alarms, false alarms, delayed alarm flood detection, and alarm reordering, to replicate real-world alarm data degradation. We evaluate our methodology using a novel alarm dataset derived from the Tennessee-Eastman process, while examining the robustness of six relevant AFC methods from the literature. The results demonstrate significant variations in robustness across different AFC methods and perturbation types, providing insights into their practical reliability under various realistic scenarios.