Senior Data Engineer – Azure & AWS

Candidate Description

With over 11 years navigating the financial services and government sectors, this senior data engineering professional excels at architecting and delivering large-scale cloud and big-data solutions. Leveraging deep expertise in AWS, Azure, Apache Spark and Databricks, they have supported high-profile organisations such as a Financial Institution, an Insurance Company, a Financial Services Firm and a Government Agency with complex data platform modernisation initiatives. Their strengths span data lake architecture, scalable ETL design, and cross-team stakeholder engagement.

Their technical acumen is reflected in the delivery of Spark-based credit risk data pipelines, real-time trading analytics platforms and automated regulatory reporting frameworks. Adept at Python, Scala, SQL and Java, they implement robust CI/CD practices using Git, TeamCity and AutoSys, and orchestrate workflows through Airflow, Oozie and AWS Glue. Key achievements include integrating major credit bureau data sources for comprehensive credit reporting, and slashing FX trading latency by 80 % through JVM tuning.

A collaborative leader and mentor, they guide multidisciplinary teams in Agile and Scrum environments, cultivating a culture of continuous improvement and knowledge sharing. Their proven adaptability across consulting, banking, insurance and government projects underscores a capacity to deliver value in diverse settings. Organisations benefit from their blend of strategic vision and hands-on technical depth, ensuring data platforms are performant, compliant and ready to fuel advanced analytics.