Distributed Framework for Political Event Coding in Real-Time

Studying political activities and interaction between different entities gradually becoming a prominent field of research for both the social science and computer science researchers. Research is being carried out at local (limited to a particular region) and global scale, often divided in temporal manner. It is also useful to have a most recent dataset to have an up-to-date analysis. For these purposes, we need time stamped, structured information about political interactions. Keeping this in mind, we develop a distributed framework that works in real-time with Apache Kafka and SPARK for processing a global collection of news data in different languages (i.e., Spanish, Arabic) and generate those structured data. We also provide a API for easy access to the data. In this paper, we will describe how the system works, how to access the data and possible analytical problems that can be addressed by building a model on the dataset.