Cost-Effective Valuable Data Detection Based on the Reliability of Artificial Intelligence

Many previous studies have investigated applying artificial intelligence (AI) to cyber security. Despite considerable performance advantages, AI for cyber security requires final confirmation by an analyst, e.g. malware misdetection can cause significant adverse side effects. Thus, a human analyst must check all AI predictions, which poses a major obstacle to AI expansion. This paper proposes a reliability indicator for AI prediction using explainable artificial intelligence and statistical analysis techniques. This will enable analysts with limited daily workload to focus upon valuable data, and quickly verify AI predictions. Analysts generally make decisions based on several features that they know exactly what they mean, rather than all available features. Since the proposed reliability indicator is calculated using features meaningful to analysts, it can be easily understood and hence speed final decisions. To verify the performance of the proposed method, an experiment was conducted using the IDS dataset and the malware dataset. The AI error was detected better than the existing AI model at about 114% in IDS and 95% in malware. Thus, cyberattack response could be greatly improved by adopting the proposed method.