Data Lake Architecture for Distribution System Operator

Ignited by the advent of digital technologies, power distribution utilities are generating more and more data about their own assets and their environment. To handle this amount of data, some solutions emerge to help distribution system operators in understanding their own data and turning this Big Data into actionable insights. One of the solutions is a Data Lake. This article illustrates the architecture of a cloud-based Data Lake developed by Enel Distribuicao Sao Paulo to manage big data from systems such as GIS, SCADA O&M systems and other data generated in a Network Digital Twin^® model in the city of Sao Paulo This Data Lake has a combination of data sources. It stores data in raw, processed, and refined format using structured, unstructured and semi-structured data. It uses tools to execute queries, searches, processing streams and to visualize data. This paper presents the design and implementation details, as well as usage scenarios of the data lake in a smart grid project.