Data Lead - Azure Data Factory (ADF), Databricks
India
Job Description
Data Lead - Azure Data Factory (ADF), Databricks
Bengaluru, Karnataka
Job Summary
The Technical Lead will be responsible for leading and managing the implementation, maintenance, and support of Snowflake, Azure Data Factory (ADF), and Data Bricks solutions. The role involves overseeing the technical aspects of projects related to data engineering, data integration, and data processing using these platforms.
Key Responsibilities
Role: Data Engineer- Azure Databricks
| JD: • 4–7 years of experience in data engineering, with at least 2+ years in Databricks. • Deep hands-on expertise in Azure Databricks, PySpark, and Delta Lake. • Strong experience with Azure Data Factory, Data Lake Storage Gen2, and Azure Synapse. • Proficiency in SQL, Python, and distributed data processing. • Experience with Unity Catalog, RBAC, and managing multi-tenant data platforms. • Strong understanding of data modelling (dimensional & relational), performance tuning, and partitioning strategies. • Familiarity with event-driven architectures, including Event Hubs, Kafka, or IoT data pipelines. • Experience with Git, CI/CD tools, and Infrastructure as Code (Terraform, Bicep, or ARM templates). ________________________________________ Preferred Qualifications: • Azure certifications (e.g., DP-203: Azure Data Engineer Associate). • Exposure to streaming frameworks, ML model integration, and Power BI. • Experience working in Agile delivery environments with strong documentation and stakeholder engagement skills. |
Skill Requirements
1. Proficiency in snowflake architecture, implementation, and optimization.
2. Handson experience with azure data factory (adf) including data pipeline development, integration, and monitoring.
3. Strong knowledge of data bricks for big data processing, data engineering, and machine learning workflows.
4. In-depth understanding of data warehousing concepts, etl processes, and data modeling techniques.
5. Excellent problem-solving skills and ability to work in a fast paced environment.
6. Strong communication and leadership skills to effectively collaborate with team members and stakeholders.
2. Handson experience with azure data factory (adf) including data pipeline development, integration, and monitoring.
3. Strong knowledge of data bricks for big data processing, data engineering, and machine learning workflows.
4. In-depth understanding of data warehousing concepts, etl processes, and data modeling techniques.
5. Excellent problem-solving skills and ability to work in a fast paced environment.
6. Strong communication and leadership skills to effectively collaborate with team members and stakeholders.
Other Requirements
null
Information at a Glance
23
Benefits
At HCLTech, we believe in empowering our employees with comprehensive benefits that support their professional growth and enhance their well-being. When you sign up for a career with us, you gain access to:
https://rmkcdn.successfactors.com/147eb21f/a701dca9-f32d-4fc9-9447-6.svg
Industry-benchmarked compensation
https://rmkcdn.successfactors.com/147eb21f/b0c54381-ddcc-4a33-9b35-9.svg
Best-in-class healthcare benefits
https://rmkcdn.successfactors.com/147eb21f/b73027be-7aae-4d36-a090-4.svg
Personal time off
https://rmkcdn.successfactors.com/147eb21f/d5b4fdfd-2e99-4e26-9878-9.svg
Maternity and paternity benefits
https://rmkcdn.successfactors.com/147eb21f/3d42b0fc-4652-435a-9ece-c.svg
Access to skills / higher education programs/resources
https://rmkcdn.successfactors.com/147eb21f/aeddeaf2-9e25-4584-ad11-d.svg
Discounts on products and services via Benefit Box
https://rmkcdn.successfactors.com/147eb21f/a9609a3b-2700-4b3c-9d90-a.svg
Participate in CSR programs and live life with a purpose
https://rmkcdn.successfactors.com/147eb21f/c6e33851-710f-4634-bd69-f.svg
Opportunities to grow and advance your career
Note : The benefits listed above vary depending on the nature of your employment and the country where you work. Some benefits may be available in some countries but not in all.