Big Data Framework Deployment and Solution Design of Agricultural Internet of Things

This paper introduces the overall design scheme of agricultural Internet of Thing (IoT) system and the design framework of software functional modules. By analyzing the MapReduce computing framework of Hadoop, HDFS distributed file storage system, resource allocation and invocation principle of YARN, and the operation framework of Spark. We build the overall structure of the Hadoop-based Spark computing framework and deploy the Hadoop-based Spark cluster.