Senior Data Lead - Azure Data Factory (ADF), Databricks
India
Job Description
Senior Data Lead - Azure Data Factory (ADF), Databricks
Noida, Uttar Pradesh

Job Summary

The Senior Technical Lead will be responsible for leading technical teams and overseeing the implementation of projects related to Snowflake, Azure Data Factory (ADF), and Data Bricks. The role involves ensuring the successful delivery of data solutions and optimizing data pipelines for efficient performance.

Data Engineer

Our Data Engineers play a key role in evolving our data platform – responsible for the design, build and support of secure, scalable and trusted data pipelines that power critical products and insights across the organisation. Our data platform supports a wide range of audience, content and commercial use cases. It processes large‑scale event and relational data to power analytics, reporting, experimentation, and downstream products across BBC Studios, with a strong emphasis on data trust, security and governance. 

 

Key Responsibilities

  • Build and maintain high‑quality, automated data pipelines for ingesting, transforming and publishing data. 
  • Ensure data pipelines follow agreed standards for reliability, scalability, security and performance. 
  • Work with senior engineers and architects to implement core platform patterns, tooling and capabilities. 
  • Apply appropriate security, privacy and governance controls to protect audience data and enable its safe, compliant use. 
  • Collaborate closely with engineers, product, analytics and data governance partners to deliver valuable data solutions. 
  • Support the platform in production, contributing to monitoring, incident resolution and continuous improvement. 
  • Continuously learn and stay up to date with data engineering tools, technologies and ways of working. 


Required Skills & Experience

  • Experience building or supporting data pipelines for analytics or data platforms. 
  • Strong SQL skills and experience working with data warehouses and transformation tools (e.g. dbt). 
  • Understanding of data modelling and good database design practices. 
  • Familiarity with pipeline orchestration and automated data workflows. 
  • Good engineering practices: writing clean, maintainable code, testing, and working with CI/CD pipelines 
  • Comfortable working in an agile delivery environment (Scrum or Kanban). 
  • Familiarity with cloud platforms and infrastructure-as-code concepts (preferably AWS and Terraform). 
  • A collaborative mindset and ability to work effectively within a team

 

Desirable Skills & Experience 

  • Experience with Python or another high‑level programming language 
  • Familiarity with large‑scale data processing technologies 
  • Exposure to Snowflake or similar cloud data warehouses 
  • Experience using AI‑assisted development tools (e.g. Copilot, Claude) to improve productivity 

 

 

Key Responsibilities

Data Engineer

Our Data Engineers play a key role in evolving our data platform – responsible for the design, build and support of secure, scalable and trusted data pipelines that power critical products and insights across the organisation. Our data platform supports a wide range of audience, content and commercial use cases. It processes large‑scale event and relational data to power analytics, reporting, experimentation, and downstream products across BBC Studios, with a strong emphasis on data trust, security and governance. 

 

Key Responsibilities

  • Build and maintain high‑quality, automated data pipelines for ingesting, transforming and publishing data. 
  • Ensure data pipelines follow agreed standards for reliability, scalability, security and performance. 
  • Work with senior engineers and architects to implement core platform patterns, tooling and capabilities. 
  • Apply appropriate security, privacy and governance controls to protect audience data and enable its safe, compliant use. 
  • Collaborate closely with engineers, product, analytics and data governance partners to deliver valuable data solutions. 
  • Support the platform in production, contributing to monitoring, incident resolution and continuous improvement. 
  • Continuously learn and stay up to date with data engineering tools, technologies and ways of working. 


Required Skills & Experience

  • Experience building or supporting data pipelines for analytics or data platforms. 
  • Strong SQL skills and experience working with data warehouses and transformation tools (e.g. dbt). 
  • Understanding of data modelling and good database design practices. 
  • Familiarity with pipeline orchestration and automated data workflows. 
  • Good engineering practices: writing clean, maintainable code, testing, and working with CI/CD pipelines 
  • Comfortable working in an agile delivery environment (Scrum or Kanban). 
  • Familiarity with cloud platforms and infrastructure-as-code concepts (preferably AWS and Terraform). 
  • A collaborative mindset and ability to work effectively within a team

 

Desirable Skills & Experience 

  • Experience with Python or another high‑level programming language 
  • Familiarity with large‑scale data processing technologies 
  • Exposure to Snowflake or similar cloud data warehouses 
  • Experience using AI‑assisted development tools (e.g. Copilot, Claude) to improve productivity 

 

 

Skill Requirements

1. Proficiency in snowflake, including data modeling, querying, and performance optimization.
2. Strong experience in azure data factory (adf) for data integration and orchestration.
3. Handson knowledge of data bricks for data engineering, data processing, and machine learning.
4. Ability to design, develop, and optimize complex data pipelines for etl processes.
5. Strong problem-solving skills and the ability to troubleshoot data pipeline issues.
6. Excellent communication skills to interact with technical and nontechnical stakeholders effectively.
7. Strong leadership skills to guide and motivate technical teams towards project delivery and success.
8. Experience in agile methodologies and project management practices for efficient project execution.

Other Requirements

1.Relevant certifications in Snowflake, Azure Data Factory (ADF), DataBricks are a plus.

Data Engineer

Our Data Engineers play a key role in evolving our data platform – responsible for the design, build and support of secure, scalable and trusted data pipelines that power critical products and insights across the organisation. Our data platform supports a wide range of audience, content and commercial use cases. It processes large‑scale event and relational data to power analytics, reporting, experimentation, and downstream products across BBC Studios, with a strong emphasis on data trust, security and governance. 

 

Key Responsibilities

  • Build and maintain high‑quality, automated data pipelines for ingesting, transforming and publishing data. 
  • Ensure data pipelines follow agreed standards for reliability, scalability, security and performance. 
  • Work with senior engineers and architects to implement core platform patterns, tooling and capabilities. 
  • Apply appropriate security, privacy and governance controls to protect audience data and enable its safe, compliant use. 
  • Collaborate closely with engineers, product, analytics and data governance partners to deliver valuable data solutions. 
  • Support the platform in production, contributing to monitoring, incident resolution and continuous improvement. 
  • Continuously learn and stay up to date with data engineering tools, technologies and ways of working. 


Required Skills & Experience

  • Experience building or supporting data pipelines for analytics or data platforms. 
  • Strong SQL skills and experience working with data warehouses and transformation tools (e.g. dbt). 
  • Understanding of data modelling and good database design practices. 
  • Familiarity with pipeline orchestration and automated data workflows. 
  • Good engineering practices: writing clean, maintainable code, testing, and working with CI/CD pipelines 
  • Comfortable working in an agile delivery environment (Scrum or Kanban). 
  • Familiarity with cloud platforms and infrastructure-as-code concepts (preferably AWS and Terraform). 
  • A collaborative mindset and ability to work effectively within a team

 

Desirable Skills & Experience 

  • Experience with Python or another high‑level programming language 
  • Familiarity with large‑scale data processing technologies 
  • Exposure to Snowflake or similar cloud data warehouses 
  • Experience using AI‑assisted development tools (e.g. Copilot, Claude) to improve productivity 

 

 

Information at a Glance

Why HCLTech?

At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.

HCLTech is a global technology company, home to more than 226,300 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2025 totaled $14.5 billion.

23 Benefits At HCLTech, we believe in empowering our employees with comprehensive benefits that support their professional growth and enhance their well-being. When you sign up for a career with us, you gain access to: https://rmkcdn.successfactors.com/147eb21f/a701dca9-f32d-4fc9-9447-6.svg Industry-benchmarked compensation https://rmkcdn.successfactors.com/147eb21f/b0c54381-ddcc-4a33-9b35-9.svg Best-in-class healthcare benefits https://rmkcdn.successfactors.com/147eb21f/b73027be-7aae-4d36-a090-4.svg Personal time off https://rmkcdn.successfactors.com/147eb21f/d5b4fdfd-2e99-4e26-9878-9.svg Maternity and paternity benefits https://rmkcdn.successfactors.com/147eb21f/3d42b0fc-4652-435a-9ece-c.svg Access to skills / higher education programs/resources https://rmkcdn.successfactors.com/147eb21f/aeddeaf2-9e25-4584-ad11-d.svg Discounts on products and services via Benefit Box https://rmkcdn.successfactors.com/147eb21f/a9609a3b-2700-4b3c-9d90-a.svg Participate in CSR programs and live life with a purpose https://rmkcdn.successfactors.com/147eb21f/c6e33851-710f-4634-bd69-f.svg Opportunities to grow and advance your career Note: The benefits listed above vary depending on the nature of your employment and the country where you work. Some benefits may be available in some countries but not in all.