Residential Building Consumption Data Management
The goal of this ongoing project is to enhance the sustainability of residential buildings by processing various types of consumption data. The data managed includes water and energy consumption (differentiating between private homes and common areas, such as HVAC and water heating systems), photovoltaic energy generation, motion sensors in communal spaces, environmental sensors, and waste management.
This project, which is still in progress, included a results presentation at the 2023 Mobile World Congress in Barcelona. As part of a series of connectivity-focused sessions organized by Huawei, attendees were offered a demonstration of the management dashboard’s potential and its integration with the different systems installed in each building.
The project involves constant coordination with the teams responsible for the installation and management of various metering devices. Data from these meters is stored in MySQL databases, sometimes requiring pre-processing using Python. In addition to meter readings, data is also gathered from other platforms, such as Datadis (a platform that centralizes energy measurement data from Spanish utility companies), APIs from photovoltaic management platforms (e.g., Sunny Portal by ennexOS, SolaX Power), and APIs from environmental sensor platforms (e.g., Tuya).
Once consumption data is collected and processed, it is connected to Power BI, where consumption dashboards are generated. These dashboards allow users to visualize global consumption, household-specific data, data for specific time periods or time slots. They also provide trends, comparisons between different time frames and years, etc. This enables the identification of consumption patterns, detection of anomalies, and ultimately the implementation of measures to promote more efficient and sustainable consumption across buildings.
The dashboards are embedded into a web platform developed with the Python tool Streamlit, allowing the client to quickly and easily access the results.
Project dates: May 2023 – Present
Tools used:
- Python
- Streamlit
- Power BI
- AWS
- GCP
- MySQL
- Datadis
- API (Sunny Portal by ennexOS, SolaX Power, Tuya)
- Excel
Interactive Power BI Dashboard on Energy Consumption in Buildings