Distributed Processing from Large Scale Sensor Network Using Hadoop

Big data refers to large amounts of data, normally in unstructured forms, such as text, sensor data, audio, video, log files, and more. When collecting from a large number of nodes, sensor networks can produce large data sets. Climate and sensor network data are applied to assist the decision making process in agricultural production. In this paper we present the main aspects of a prototype to test Hadoop framework applied to process climate related data sets in a cloud computing infrastructure.