Job Summary
We are seeking an experienced Azure Data Factory (ADF) Developer with a strong background in ETL/ELT development, data integration, and metadata-driven ingestion frameworks. The ideal candidate should have hands-on experience designing, developing, and optimizing scalable data pipelines using Azure data services.
Key Responsibilities
Key Responsibilities
Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
Develop metadata-driven ingestion frameworks for handling multiple source systems.
Build and manage end-to-end data movement solutions across databases, files, APIs, and cloud platforms.Create reusable and parameterized ADF pipelines for scalable data integration.
Develop data transformation logic using Mapping Data Flows, Azure Databricks, SQL, or other Azure services.
Implement monitoring, logging, error handling, and performance optimization mechanisms.
Collaborate with business analysts, architects, and data engineers to understand requirements and deliver solutions.
Perform code reviews, deployment activities, and production support.
Skill Requirements
Required Skills
5+ years of ETL development experience.Strong hands-on experience with Azure Data Factory (ADF).
Experience developing metadata-driven ingestion frameworks.
Strong knowledge of ETL/ELT concepts, data warehousing, and dimensional modeling.
Proficiency in SQL and database technologies (SQL Server, Azure SQL, Synapse, etc.).
Experience working with REST APIs, JSON, XML, CSV, and other data formats.
Knowledge of Azure Data Lake Storage (ADLS Gen2).Experience with CI/CD implementation using Azure DevOps.
Understanding of data quality, performance tuning, and troubleshooting techniques.
Preferred Skills
Experience with Azure Databricks and PySpark.Knowledge of Delta Lake and Medallion Architecture.
Experience with Azure Synapse Analytics.Exposure to Python scripting.
Understanding of data governance and security best practices.
Other Requirements
Nice to Have
Microsoft Azure Data Engineer certifications.Experience in large-scale cloud migration and data modernization programs.