Making Decisions in Intelligent Video Surveillance Systems Based on Modeling the Pupillary Response of a Person

The prospects for using artificial intelligence in video analytics are becoming more and more undeniable. Researchers are actively working on methods for making decisions based on the results of automated analysis of the sequence of images received from video cameras. The purpose of our study was to develop a method for decision-making based on modeling a person's pupillary response to an information stimulus. A ZWO ASI120MC digital video camera was used for research. The studies carried out made it possible to reliably establish that the state of the optical system of the eye when viewing the calibration slide comes to a physical state common to all people. This made it possible to systematize the pupillograms, referring them to one of two categories (stress state is / is not). Having determined an individual threshold value during calibration, it becomes possible to quickly classify a person's emotional response to the received information impulse. Based on the developed methodology for systematizing the pupillary reaction to an information stimulus by categories, a decision tree for intelligent video surveillance systems was built. In addition to the size of the pupils, the algorithm takes into account the parameters of gaze fixation on stimulus images, the stability of the illumination of the surface of the pupils.