Extracting Psychological Features out of Drawings of HTP test

The House-Tree-Person (HTP) test is extensively used in different contexts to assess personality related issues. At test time, the respondent is requested to draw a house, a tree and a person. The drawings are later interpreted by therapists to assess emotional indicators. Due to its simplicity, this test is used with individuals aged over 3 years. This paper presents the first results of a bigger project, which aims to use artificial intelligence and image processing techniques to classify House-Tree-Person pictures, to extract psychological features out of those drawings and to find the optimal combination of those signs that may be indicative of psychological maladjustment. Having done the initial HTP classification task, this research focuses on the pictures of houses, searching for the presence/absence of the roof. This work used sketches provided by the department of Psychology of Istanbul Bilgi University and other drawings retrieved from multiple resources and from the internet. In the HTP classification task, the reached performance is 96.81% and 98.84% in the validation and test sets, respectively. In the roof detection task, the achieved accuracy is 70.73%, over a test set of 41 "house" images from which 29 were correctly classified.