Senior Data Engineer (Azure & Databricks)

Candidate Description

An accomplished Data Engineer with 16 years of hands-on experience in designing and implementing modern data lakehouse and data warehouse solutions. Proficient in Microsoft Azure tools such as Data Factory, Databricks, Azure Synapse Analytics, and Power BI, as well as SAP BO Suite and Data Services, this professional has a proven track record of delivering cost-effective data models, enhancing existing architectures and supporting ongoing operational projects. With extensive experience in both on-premises and cloud platforms, they have worked on complex data migration programs and have sound knowledge of SAP S/4HANA modules. Adept at developing robust data ingestion models, they have led the design and build of data marts and warehouses for BI reporting, ensuring optimal performance and business insights.

As a Senior Data Consultant, this individual has built SQL validation scripts and automated reports to enhance data quality and consistency, improving business decision-making. They have spearheaded the implementation of data migration processes using SAP Data Services and Azure Data Factory, managing the end-to-end extraction, transformation, and load (ETL) processes for SAP S/4HANA data. In their previous roles, they designed hybrid data models using Azure tools, built metadata-driven data ingestion frameworks and implemented cost-effective modern data solutions using Azure DevOps, Databricks, and Azure Synapse.

As a Senior Data Engineer, they led a team to deliver a modern DataMart integrating data from 16 sources within a year. They also architected a Databricks Unity Catalog solution for fine-grained data governance and built a secure data platform model for a major organization. Their expertise in migrating on-premises data marts to Azure and enhancing existing DataMarts with ADF and Databricks has significantly improved data access and operational efficiency.