Azure Senior Data Engineer
India
Job Description
Azure Senior Data Engineer
Job Summary
The Senior Developer will be responsible for developing and maintaining solutions using Azure Data Factory (ADF), Azure Databricks, SQL, and Python. The primary objectives includes building and optimizing data pipelines for efficient data processing and analysis.
Key Responsibilities
1. Develop and implement end-to-end data pipelines using azure data factory (adf) and azure databricks to extract, transform, and load data.
2. Write complex sql queries to retrieve and manipulate data from databases.
3. Utilize python for scripting and automation tasks related to data processing and analysis.
4. Collaborate with data engineers and analysts to understand data requirements and deliver appropriate solutions.
5. Monitor and optimize data workflows to ensure high performance and scalability.
6. Troubleshoot and resolve issues related to data pipelines and data quality.
2. Write complex sql queries to retrieve and manipulate data from databases.
3. Utilize python for scripting and automation tasks related to data processing and analysis.
4. Collaborate with data engineers and analysts to understand data requirements and deliver appropriate solutions.
5. Monitor and optimize data workflows to ensure high performance and scalability.
6. Troubleshoot and resolve issues related to data pipelines and data quality.
Skill Requirements
1. Strong understanding of azure data factory (adf) for building and managing data pipelines.
2. Experience with azure databricks for big data processing and analytics.
3. Strong sql skills for querying and manipulating data in relational databases.
4. Solid knowledge of python programming language for data manipulation and automation.
5. Understanding of data integration concepts and etl processes.
6. Ability to work in a collaborative team environment and communicate effectively with stakeholders.
2. Experience with azure databricks for big data processing and analytics.
3. Strong sql skills for querying and manipulating data in relational databases.
4. Solid knowledge of python programming language for data manipulation and automation.
5. Understanding of data integration concepts and etl processes.
6. Ability to work in a collaborative team environment and communicate effectively with stakeholders.
Other Requirements
1.Azure Data Engineer Associate or Microsoft Certified1.Azure Data & AI Associate certification is a plus.
Information at a Glance
23
Benefits
At HCLTech, we believe in empowering our employees with comprehensive benefits that support their professional growth and enhance their well-being. When you sign up for a career with us, you gain access to:
https://rmkcdn.successfactors.com/147eb21f/a701dca9-f32d-4fc9-9447-6.svg
Industry-benchmarked compensation
https://rmkcdn.successfactors.com/147eb21f/b0c54381-ddcc-4a33-9b35-9.svg
Best-in-class healthcare benefits
https://rmkcdn.successfactors.com/147eb21f/b73027be-7aae-4d36-a090-4.svg
Personal time off
https://rmkcdn.successfactors.com/147eb21f/d5b4fdfd-2e99-4e26-9878-9.svg
Maternity and paternity benefits
https://rmkcdn.successfactors.com/147eb21f/3d42b0fc-4652-435a-9ece-c.svg
Access to skills / higher education programs/resources
https://rmkcdn.successfactors.com/147eb21f/aeddeaf2-9e25-4584-ad11-d.svg
Discounts on products and services via Benefit Box
https://rmkcdn.successfactors.com/147eb21f/a9609a3b-2700-4b3c-9d90-a.svg
Participate in CSR programs and live life with a purpose
https://rmkcdn.successfactors.com/147eb21f/c6e33851-710f-4634-bd69-f.svg
Opportunities to grow and advance your career
Note : The benefits listed above vary depending on the nature of your employment and the country where you work. Some benefits may be available in some countries but not in all.