The Operating Status Platform of the National Electric Power Coordinator allows to trace the operating status records of the generating units of the electric system and the calculation of the main indexes that will enable to determine the Sufficiency Power (capacity of a system to supply the peak-to-peak demand) and the generation unavailability indexes.
Business challenges
The Coordinator must keep a record of the operating status of the power supply of the generating units. To make this record, they compiled the information from multiple sources and performed complex manual processing, making extensive use of spreadsheets.
complex manual processing, making extensive use of spreadsheets to resolve critical information.
to resolve critical information. On the other hand, the quality of the information, processing time and access to the
processing time and access to information are major challenges associated with the implementation of this platform.
associated with the implementation of this platform.
Arkhotech proposed the creation of a system accessible to generating companies, which would facilitate the
The system would facilitate the process of calculation, traceability and review of the main indicators that affect the Sufficiency Power and Generation Unavailability. With this platform the Coordinator could:
Mitigate the possibility of incurring errors, replacing the application of manual formulas and data processing with a 5-year window with automatic calculations.
Make information available. The system has a public and private view that allows access to information and provides greater transparency in the calculation process.
Reduce processing time and improve the quality of information, achieving greater efficiency in the Markets department.
Unified registration through the construction of a data lake, consolidating the information as a single point of truth.
Solution
Our solution consisted in the construction of a data exploration platform, which enables the management of large volumes of information in a Data Lake, and that through an administrative web interface allows the loading, visualization and generation of calculations, as well as the consultation of the Operating States of the generating plants,
and generation of calculations, as well as the consultation on the Operational States of the power generating plants.
power plants.
The data sources of the application are combined between Excel templates, APIs and databases, which are stored (RAW Layer)
and processed (Staging Layer) using Apache NiFi. The information is consolidated in a PostgreSQL RDS database which
operational model of the system. The web application is built as a static Angular site accelerated with
CloudFront and accessible through authentication with Cognito. The backend layer, contemplates a micro-services architecture,
developed in Flask with Python, orchestrated and scalable using Amazon EKS. Data processing is visible to the user in a control panel that integrates
in a control panel that integrates with notifications via SES.
Results
Construction of a data exploration platform, which enables the management of large volumes of information, allowing complex processing of more than 10,000 records in less than 5 minutes.
A web interface that allows the uploading, visualization and generation of calculations that determine the Sufficiency Power and the energy generation unavailability indexes, which allowed a 98.86% reduction in the calculation time.
Public and private availability of information. Improvement in the quality of information and openness of data.
Support tool for compliance with DS62, NTTP, NTS and CS regulations.
Other experiences in Arkho
Providing technology for the analysis of key business information.
"We had the goal of having "zero humans" platforms, which are not easy to build or evangelize when transformations are so disruptive. Hand in hand with Arkhotech, we achieved it."