Senior Data Engineer – Databricks

Candidate Description

A versatile Senior Data Engineer with more than a decade of experience designing and delivering cloud-native data solutions, they excel in harnessing Microsoft Azure and Databricks to unlock enterprise insights. Having navigated consulting, pharmaceuticals, financial services, and superannuation sectors, this professional blends deep technical expertise with a keen understanding of governance, security, and stakeholder alignment. Their toolkit spans Azure Data Factory, Azure Synapse Analytics, Azure SQL, and advanced Python/PySpark programming, underpinned by robust data-modelling and warehousing principles.

Their technical acumen is showcased through the successful migration of terabyte-scale datasets from a Major Cloud Provider to Microsoft Azure for a Technology Company s banking clients, the creation of CI/CD pipelines in Azure DevOps that halved deployment errors, and the optimisation of Databricks transformations that cut processing time by 40%. Adept at Agile and Kanban methodologies, they routinely lead code reviews, enforce data-quality frameworks, and collaborate with analysts to craft predictive models and curated datamarts that accelerate decision-making.

Combining leadership with hands-on delivery, they mentor offshore teams, translate complex requirements into scalable architectures, and drive best practices across data engineering communities. Their cross-industry adaptability, certification as a Microsoft Azure Data Engineer Associate, and proven record of boosting analytics performance position them as a valuable asset for organisations seeking to mature their data platforms and realise tangible business value.