Photo by American Public Power Association on Unsplash
Engineering project
An energy data platform on Azure
Bring business-application data into an Azure platform and make it available for analysis in Power BI.
The project
Data engineering for a group operating in solar energy. The assignment combines Azure Data Factory pipelines, business-system integrations and Power BI dashboards, with SQL maintenance of the data warehouse.
Engineering approach
The application APIs expose different data objects and update schedules. Azure Data Factory orchestrates ingestion; SQL transformations structure the warehouse data for use in Power BI.
Work delivered
A processing and reporting chain connecting application integrations, data preparation and dashboards.
My contribution
- Development and maintenance of Azure Data Factory pipelines
- Integration of Microsoft Graph, Business Central and Microsoft 365 APIs
- Development of Power BI dashboards and SQL scripts for the warehouse
Functional overview
Azure Data Factory feeds the SQL warehouse from Business Central and Microsoft Graph APIs. SQL transformations prepare the data used in Power BI.
Business Central
Azure Data Factory
Microsoft Graph
Microsoft 365
Power BI
Components and flows
- Access to business-system and Microsoft-service data through their APIs
- Azure Data Factory orchestration and SQL transformations into the warehouse
- Power BI models and dashboards use warehouse data
Related capabilities
Services by sector
Other projects
Discuss your project
A discussion of your project’s design, development and production deployment.