Data Engineer (Azure & Databricks)

Candidate Description

A dynamic and results-driven Data Engineer with four years of hands-on experience in Azure Synapse, Azure Data Factory, Databricks, and SQL, delivering cutting-edge data solutions that meet the needs of businesses across healthcare and financial services. With strong expertise in Python, REST APIs, and cloud data architecture, this professional has successfully developed and maintained scalable ETL pipelines, leading data migration projects and improving performance through cost-effective cloud solutions. They are skilled in working with complex datasets and driving data transformation processes and are adept at supporting technical and strategic business goals.

This individual has extensive experience in designing and implementing ELT processes, using Azure Synapse and ADF to develop data pipelines for financial reporting and business intelligence. They have led the migration of data architecture from Synapse to Azure Data Warehouse, resulting in performance enhancements and cost reductions. Their role includes creating REST APIs using Python, transitioning pipelines to ADF, and establishing CI/CD processes in Azure DevOps. Their previous experience in financial services involved managing data ingestion, running crucial business processes, and delivering insights for large-scale financial reports.

They successfully delivered a project to migrate the company’s data architecture from Synapse to Azure Data Warehouse, improving performance and reducing costs. Additionally, they created a Python-based REST API to fetch data and propagate it across the business, ensuring seamless data flow. In financial services, they managed significant data volumes, ensuring accurate reporting and analysis, and played a key role in migrating pipelines from SSIS to ADF, modernizing the data infrastructure.