Senior Data Lead - Azure Data Factory (ADF), Databricks
India
Apply now
Job Description
Senior Data Lead - Azure Data Factory (ADF), Databricks
Bengaluru, Karnataka

Job Summary

Experienced Data Engineer / Specialist for designing, developing, and maintaining robust data pipelines and solutions on Microsoft Azures. The ideal candidate to have strong technical expertise in Microsoft Azure services: Azure Data Factory, Azure Synapse, Azure SQL, Azure Databricks, etc.  The ideal candidate will work closely with cross-functional teams to ingest, transform, and optimize data for business intelligence, reporting, and advanced analytics use cases.

Key Responsibilities

Design, develop, and maintain robust data pipelines using Azure Data Factory, Synapse Analytics, and other Azure services.

•               Design and manage data models in Azure Synapse Analytics and Azure SQL Database.

•               Build and optimize ETL/ELT pipelines using Azure Data Factory (ADF) for data ingestion and transformation.

•               Develop scalable data processing/ data transformation workflows using Azure Databricks, PySpark, and Spark SQL.

•               Develop and maintain data ingestion, transformation, and orchestration workflows.

•               Develop and maintain data models for analytics and reporting.

•               Build reusable, high-performance data models for analytics and reporting.

•               Monitor, troubleshoot, and optimize performance of data pipelines.

•               Implement best practices for version control, CI/CD, and automation.

•               Document data architecture, processes, and best practices.

Skill Requirements

•               Proficiency in Microsoft Azure services:  Azure Data Factory (ADF) for data orchestration (for building and managing pipelines), Azure Databricks for big data processing and analytics, Azure Synapse and Azure SQL).

•               Experience with Power BI, Tableau/OBIEE.

•               Proficiency in PySpark, Python, and Spark SQL for data manipulation and transformation.

•               Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.

•               Understanding of ETL/ELT design patterns and best practices.

•               Solid understanding of data warehouse best practices, development standards and methodologies..

•               Strong understanding of data modeling, data governance, and performance tuning and optimization of Spark jobs.

•               Experience with CI/CD pipelines and DevOps practices in data engineering.

•               Experience with ETL/ELT patterns and best practices.

Other Requirements

•               DevOps & CI/CD: Azure DevOps, GitHub Actions, Jenkins

•               Experience in Data Lakehouse architectures and Delta Lake

•               Knowledge of real-time data streaming (Event Hubs, Kafka)
Apply now
Information at a Glance

Why HCLTech?

At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.

HCLTech is a global technology company, home to more than 226,300 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2025 totaled $14.5 billion.
23 Benefits At HCLTech, we believe in empowering our employees with comprehensive benefits that support their professional growth and enhance their well-being. When you sign up for a career with us, you gain access to: https://rmkcdn.successfactors.com/147eb21f/a701dca9-f32d-4fc9-9447-6.svg Industry-benchmarked compensation https://rmkcdn.successfactors.com/147eb21f/b0c54381-ddcc-4a33-9b35-9.svg Best-in-class healthcare benefits https://rmkcdn.successfactors.com/147eb21f/b73027be-7aae-4d36-a090-4.svg Personal time off https://rmkcdn.successfactors.com/147eb21f/d5b4fdfd-2e99-4e26-9878-9.svg Maternity and paternity benefits https://rmkcdn.successfactors.com/147eb21f/3d42b0fc-4652-435a-9ece-c.svg Access to skills / higher education programs/resources https://rmkcdn.successfactors.com/147eb21f/aeddeaf2-9e25-4584-ad11-d.svg Discounts on products and services via Benefit Box https://rmkcdn.successfactors.com/147eb21f/a9609a3b-2700-4b3c-9d90-a.svg Participate in CSR programs and live life with a purpose https://rmkcdn.successfactors.com/147eb21f/c6e33851-710f-4634-bd69-f.svg Opportunities to grow and advance your career Note: The benefits listed above vary depending on the nature of your employment and the country where you work. Some benefits may be available in some countries but not in all.