By Topic

Detecting future social unrest in unprocessed Twitter data: “Emerging phenomena and big data”

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

5 Author(s)
Ryan Compton ; HRL Laboratories, Malibu, California, USA ; Craig Lee ; Tsai-Ching Lu ; Lalindra De Silva
more authors

We have implemented a social media data mining system capable of forecasting events related to Latin American social unrest. Our method directly extracts a small number of tweets from publicly-available data on, condenses similar tweets into coherent forecasts, and assembles a detailed and easily-interpretable audit trail which allows end users to quickly collect information about an upcoming event. Our system functions by continually applying multiple textual and geographic filters to a large volume of data streaming from via the public API as well as a commercial data feed. To be specific, we search the entirety of for a few carefully chosen keywords, search within those tweets for mentions of future dates, filter again using various logistic regression classifiers, and finally assign a location to an event by geocoding retweeters. Geocoding is done using our previously-developed in-house geocoding service which, at the time of this writing, can infer the home location for over 62M users [1]. Additionally, we identify demographics likely interested in an upcoming event by searching retweeter's recent posts for demographic-specific keywords.

Published in:

Intelligence and Security Informatics (ISI), 2013 IEEE International Conference on

Date of Conference:

4-7 June 2013