Senior Azure Data Engineer

Candidate Description

A seasoned Senior Data Engineer with over 12 years of experience architecting and optimising data platforms across energy, utilities, and consulting sectors. Demonstrating mastery in Azure, Databricks, and modern lakehouse patterns, this professional excels at delivering real-time analytics and resilient data pipelines for critical market-operation environments such as those managed by a Major Energy Operator.

Leveraging deep expertise in PySpark, Azure Synapse, and Azure Data Factory, they have designed high-throughput pipelines that process more than 750,000 records daily, enabled 45% faster system responses, and improved grid-stability payment accuracy by 25% for projects at a Consulting Firm. Their technical repertoire spans CI/CD with Azure DevOps, Kubernetes orchestration, complex data-migration strategies from Oracle to Cosmos DB, and advanced optimisation techniques including Spark performance tuning and cost-effective storage design.

Beyond core engineering skills, this individual brings leadership and mentorship capabilities, guiding multi-disciplinary teams through regulatory compliance and Agile delivery cycles. Their adaptability across large-scale transformation programmes, combined with a Databricks Certified Data Engineer Associate credential and a solid computer-science foundation, positions them as a high-value contributor able to drive data-driven decision-making and operational excellence in fast-paced organisations.