Analysis of Blockchain and Interplanetary File System (IPFS) Utilization for Big Data Architecture Optimization

Big data is the collection of very complex data sets that are very difficult to process by traditional data processing applications. This data comes from various devices or media that are connected to the internet. Today, big data processing uses Cloud and Hadoop, which are capable of processing large amounts of data. However, as centralized storage paradigms, Cloud and Hadoop are vulnerable to Single Point of Failure, low availability, system failure, or even hacker attacks. In this research, a big data architecture using Blockchain and Interplanetary File System (IPFS) is designed and a comparison is made between big data architecture using Hadoop and big data architecture using Blockchain and IPFS and testing the time and throughput required by each architecture. The final result of this research is a discussion of the comparison of data execution based on time and throughput in each architecture. The comparison result shows that the throughput and time generated by Hadoop’s big data architecture are better with a comparison ratio value for file size 500 MB of 1.7320, file size 700 MB of 1.7915, and file size 1 GB of 1.6975.