Detecting Subject-Weapon Visual Relationships

Computer vision-based weapon detection method- ologies and applications in safety and security have fallen behind when compared to state-of-the-art computer vision applications problems in other areas. In this paper we propose a novel visual relationship detection model trained on the Open Images V6 dataset to detect the visual relationships of “holds” and “wears” between people and objects. We also introduce an application of the proposed model to detect if weapons are being held. Weapons are an unseen object class to the network. The best proposed model achieves an accuracy of 90.01% ±2.05 % on the test set of the Open Images V6 dataset for classifying the “holds” and “wears” visual relationships.