Big data infrastructure: Storage considerations

Building a big data processing cluster needs extra care on selecting right storage device, Operating System(OS) and their configuration. A wrong strategy may lead to a very slow cluster which becomes inefficient to processing data in considerable amount of time. In this work we will show how the performance varies with different setup using Hadoop Distributed File System(HDFS) and related tools.