Highly Available Hadoop NameNode Architecture

In past few years Hadoop Distributed File System (HDFS) has been used by many organizations with gigantic data sets and streams of operations on it. HDFS provides distinct features like, high fault tolerance, scalability, etc. The Name Node machine is a single point of failure (SPOF) for a HDFS cluster. If the Name Node machine fails, the system needs to be re-started manually, making the system less available. This paper proposes a highly available architecture and its working principle for the HDFS Name Node against its SPOF utilizing well-known 2-Phase Commit (2PC) Protocol and Election algorithm.