Job Description:

We are looking for a skilled Azure Data Engineer to work on enterprise-scale data projects. You will be responsible for building, optimizing, and supporting data solutions in the Corporate Data Lake using Microsoft Azure technologies.

Job Responsibilities:

•  Design, build, and  maintain end-to-end data pipelines using Azure Data Factory (ADF), Azure      Databricks (PySpark), and Azure Data Lake Storage Gen2 (ADLS Gen2)
• Implement and manage Data Lake / Data Warehouse solutions, following best practices (e.g., Medallion Architecture – Bronze/Silver/Gold)
• Develop ETL/ELT workflows for batch and incremental data processing
• Perform data transformations using PySpark and SQL
• Deploy data pipelines and components to production using CI/CD pipelines (Azure DevOps/ GitLab)
• Handle L3 support, production issues, and assist during UAT
• Ensure data quality, performance optimization, monitoring, and reliability
• Collaborate closely with team members and business stakeholders

Must-Have Skills

• 5+ years of experience as a Data Engineer / Azure Data Engineer
• Strong hands-on experience with:
  • Azure Data Factory (ADF)
  • Azure Databricks
  • Python & PySpark
  • SQL
  • Azure Data Lake (ADLS Gen2)
• Experience in Data Warehousing / Data Lake development
• Good understanding of data modeling
• Experience with CI/CD pipelines using Azure DevOps or GitLab
• Production support experience (L3/UAT)

Good to Have (Optional)

• Power BI, Power Apps, or Power Automate
• Experience with  Delta Lake, Unity Catalog, or Azure Synapse
• Exposure to incremental loads, CDC, SCD concepts

Primary Skills:

• Azure
• Python
• Data Modeling

Other Skills:

• PowerBI