Extracting Theory from Black Boxes: Using Machine Vision APIs in Communication Research

The increasing volume of images published digitally requires social science and communication researchers to employ methods able to perform visual content analysis at a large scale. Ongoing advances in machine vision and the ability to automatically detect objects, concepts and features in images provide a promising opportunity to address this challenge, yet it is often not feasible for social science researchers to develop their own custom classifier given the volume of images, resources and technical expertise needed. We therefore propose a research protocol with which existing pre-trained (commercial) models can be used for theory-building purposes despite their black box approach.