Senior Azure Data Engineer

Candidate Description

With over 17 years immersed in data engineering and analytics, this Lead Engineer excels at architecting and delivering scalable solutions across cloud and on-premises environments. Their breadth spans Python, Spark, SQL-family languages and modern Azure services, enabling high-performance data pipelines and insightful business intelligence for organisations such as a Logistics Company, a Consulting Firm’s client and financial institutions including a Financial Institution and another Financial Institution. Adept at interfacing with stakeholders, they combine deep technical skill with strong analytical and communication abilities.

Adept at leveraging Azure Databricks, Synapse Analytics and Delta Lake, they have implemented medallion architectures, CDC-driven streaming pipelines and optimised transformation layers that drive real-time insights. Their technical repertoire covers Kafka, Flink, Informatica, SSIS and a spectrum of DevOps tools—GitHub Actions, Azure DevOps, Jenkins and a Deployment Tool—enabling CI/CD automation and robust release management. Key achievements include reducing pipeline runtimes from hours to seconds for an Energy Company, delivering near-real-time CDC ingestion for a Fleet Management Company, and automating deployment processes that saved multiple days per release at a Financial Institution.

Combining leadership with hands-on expertise, this professional has guided cross-functional teams, mentored developers and championed SAFe and Scrum practices to uplift delivery maturity. Their adaptability across consulting, transportation, energy and banking sectors showcases an ability to solve diverse data challenges while aligning solutions with business goals. Organisations benefit from their strategic vision, commitment to quality and proven capacity to transform raw data into actionable intelligence that drives operational excellence and informed decision-making.