e-distribuzione is the main Italian energy distributor. It manages more than 1,1 million km of electricity network, with 31,5 million customers. Energy meters are being replaced with new “2nd generation” meters. Data collected by new meters has strongly increased, from one measure/month to daily readings (every 15 minutes).

We developed a specific application called “Zettabeat”: it represents e-distribuzione’s analytical platform enabling data reporting, business intelligence and big data management. Moreover, it allows users to access dashboards displaying reports and KPIs related to a wide set of business processes (e.g. energy measures, sorting, etc.). The solution is based on a data lake that is able to satisfy all the reporting needs, for which the MDM system (the Meter Data Management) is among the main data sources (it is also based on Hadoop technology). The Zettabeat platform is based on a Cloudera Hadoop cluster on AWS cloud infrastructure, which guarantees the use of TIBCO Spotfire reports on DWH Redshift powered by Spark jobs. This allows to collect and integrate data from different sources on different technologies (S3, Postgres, Redshift itself).