Evolution of spark framework for simplifying big data analytics

Most of the data was generated (about 80%) in last 2 years. Such data is captured from different sources at high velocity and comes from variety of sources. When data size reaches petabytes or more, current desktop and other system cannot handle it and requires efficient management of storage and retrieval. Such data is called Big Data. This Big Data is managed by an efficient framework called Spark. Big Data Analytics requires quick response. Spark addresses it. This paper discusses how framework Spark can be used for Big Data Analytics. Also cpu intensive task can be quickly solved in spark. An illustration of it is given by solving mathematical problem. It focuses on Spark ecosystem. This paper also compares spark with flink framework. Scala, python and java are used in spark. Scala being functional programming language is preferred.