07/01/2025 updated


100 % available
Senior Data Architect | Data Engineer with 10+ years experience in cloud-native data platforms
Chesterfield, United Kingdom
Only remote
University of Salford, MSc Project Management, DistinctionArchitectureAuditingAutomationMicrosoft AzureBusiness IntelligenceCloud EngineeringData ArchitectureInformation EngineeringData GovernanceExtract Transform Load (ETL)Data ManagementData TransformationData ModelingData QualityDevOps
Cloud Architecture
Design and implementation of cloud-native data platforms using Azure services including Data Lake, Event Hub, virtual networks, storage accounts, Network Security Groups, Data gateways, and Azure DevOps for enterprise-grade solutions
Real-time Data Streaming
Development of event-based architectures and DLT streaming pipelines for near real-time analytics using Databricks, Kafka, and Delta Streaming
Data Engineering & Automation
Creation of scalable ETL/ELT pipelines processing 20M+ records daily with Kafka, service bus, Google Analytics on Synapse and Databricks. Whilst adopting infrastructure as code practices
Business Intelligence
Implementation of Power BI solutions, SQL BI solutions, and advanced reporting architectures for data-driven decision making
Data Governance
Establishment of data standards, Data Governance Operating Model, Data Quality auditing, and compliance controls across enterprise data platforms
Data Architecture
Dimensional Modelling (Kimball), Medallion Architecture, Lakehouse Architecture, and data mesh
DevOps & IaC
Automation of deployment processes using Terraform, Docker, Azure DevOps, and YAML Pipelines for consistent infrastructure management
PySpark Development
Creation of reusable Python metaprogramming templates and data processing scripts with PySpark for data transformation workflows
Design and implementation of cloud-native data platforms using Azure services including Data Lake, Event Hub, virtual networks, storage accounts, Network Security Groups, Data gateways, and Azure DevOps for enterprise-grade solutions
Real-time Data Streaming
Development of event-based architectures and DLT streaming pipelines for near real-time analytics using Databricks, Kafka, and Delta Streaming
Data Engineering & Automation
Creation of scalable ETL/ELT pipelines processing 20M+ records daily with Kafka, service bus, Google Analytics on Synapse and Databricks. Whilst adopting infrastructure as code practices
Business Intelligence
Implementation of Power BI solutions, SQL BI solutions, and advanced reporting architectures for data-driven decision making
Data Governance
Establishment of data standards, Data Governance Operating Model, Data Quality auditing, and compliance controls across enterprise data platforms
Data Architecture
Dimensional Modelling (Kimball), Medallion Architecture, Lakehouse Architecture, and data mesh
DevOps & IaC
Automation of deployment processes using Terraform, Docker, Azure DevOps, and YAML Pipelines for consistent infrastructure management
PySpark Development
Creation of reusable Python metaprogramming templates and data processing scripts with PySpark for data transformation workflows
Experience
Professional experience10+ years
Freelancer since2021
Languages
EnglishNative speaker
Project history
- Designed & deployed event-based architecture streaming turbine event telemetry and dynamic energy pricing into Databricks.
- Automated user onboarding for 50+ teams via Terraform, Unity Catalog, and DevOps CI/CD.
- Built DLT streaming pipelines from Azure Data Lake for near real-time analytics.
- Integrated data quality auditing, delta deletion, and compliance controls into pipelines
- Environment: Azure Data Lake, Databricks (DLT, Unity Catalog), DevOps, Terraform, Azure Service Bus, Azure Event Hub, Azure Virtual Networks, NSG, Pyspark, Power BI.
- Built streaming ingestion pipelines for fan sentiment analysis & campaign attribution.
- Delivered GDPR “right to be forgotten” implementation across data lakehouse.
- Developed reusable Python metaprogramming templates for table governance.
- Automated testing & deployment using Docker, Pytest, Pydantic in Azure DevOps.
- Environment: Databricks (DLT, Delta CDC), Azure Functions, Logic Apps, Delta Lake, Pyspark, Python Pytest, Docker, Azure Data Factory, Azure Data Lake, Power BI.
- Led the definition of To-Be architecture, integration redesign, and migration plan for 15 systems.
- Established data standards, data lifecycle tracking, and event-driven middleware.
- Enabled BI reporting using a modern Azure-based data lake.
- Environment: Azure SQL, Azure DevOps, Azure Service bus, Azure Data Factory, Pulumi, Terraform, Azure Functions, Logic Apps, Power BI, Azure Virtual Networks, Integration Runtime.