Data Engineer - Azure Data Factory (ADF), Databricks
India
Job Description
Data Engineer - Azure Data Factory (ADF), Databricks
Bengaluru, Karnataka
Job Summary
The Developer will be responsible for managing and optimizing data workflows using Snowflake, Azure Data Factory (ADF), and Data Bricks. The role involves developing and maintaining data pipelines, ensuring data quality and integrity, as well as supporting data transformation and processing tasks.
Key Responsibilities
1. Develop, and implement data pipelines using snowflake, azure data factory (adf), and data bricks.
2. Optimize existing data workflows to improve efficiency and performance.
3. Collaborate with data engineers and data scientists to support data analytics and reporting requirements.
4. Monitor data pipelines and troubleshoot issues to ensure smooth operations.
5. Implement best practices for data governance, security, and compliance.
6. Document data pipeline processes and maintain clear documentation for reference.
2. Optimize existing data workflows to improve efficiency and performance.
3. Collaborate with data engineers and data scientists to support data analytics and reporting requirements.
4. Monitor data pipelines and troubleshoot issues to ensure smooth operations.
5. Implement best practices for data governance, security, and compliance.
6. Document data pipeline processes and maintain clear documentation for reference.
Skill Requirements
1. Knowledge of snowflake architecture, sql queries, and performance tuning techniques.
2. Knowledge of azure data factory (adf) including creating pipelines, data flows, and data sets.
3. Knowledge of data bricks for data processing, transformation, and analytics.
4. Understanding of data warehousing concepts, etl processes, and data modeling.
5. Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
6. Problem-solving skills and attention to detail for ensuring data accuracy and reliability.
2. Knowledge of azure data factory (adf) including creating pipelines, data flows, and data sets.
3. Knowledge of data bricks for data processing, transformation, and analytics.
4. Understanding of data warehousing concepts, etl processes, and data modeling.
5. Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
6. Problem-solving skills and attention to detail for ensuring data accuracy and reliability.
Other Requirements
1.Relevant certifications in Snowflake, Azure Data Factory, or DataBricks will be a plus.
Information at a Glance
23
Benefits
At HCLTech, we believe in empowering our employees with comprehensive benefits that support their professional growth and enhance their well-being. When you sign up for a career with us, you gain access to:
https://rmkcdn.successfactors.com/147eb21f/a701dca9-f32d-4fc9-9447-6.svg
Industry-benchmarked compensation
https://rmkcdn.successfactors.com/147eb21f/b0c54381-ddcc-4a33-9b35-9.svg
Best-in-class healthcare benefits
https://rmkcdn.successfactors.com/147eb21f/b73027be-7aae-4d36-a090-4.svg
Personal time off
https://rmkcdn.successfactors.com/147eb21f/d5b4fdfd-2e99-4e26-9878-9.svg
Maternity and paternity benefits
https://rmkcdn.successfactors.com/147eb21f/3d42b0fc-4652-435a-9ece-c.svg
Access to skills / higher education programs/resources
https://rmkcdn.successfactors.com/147eb21f/aeddeaf2-9e25-4584-ad11-d.svg
Discounts on products and services via Benefit Box
https://rmkcdn.successfactors.com/147eb21f/a9609a3b-2700-4b3c-9d90-a.svg
Participate in CSR programs and live life with a purpose
https://rmkcdn.successfactors.com/147eb21f/c6e33851-710f-4634-bd69-f.svg
Opportunities to grow and advance your career
Note : The benefits listed above vary depending on the nature of your employment and the country where you work. Some benefits may be available in some countries but not in all.