Azure Senior Data Lead

United States
Apply now
Job Description

Azure Senior Data Lead

Others, New Jersey

Job Summary

Job Description

We are looking for an experienced Databricks Data Engineer to design, develop, and maintain scalable data engineering solutions on the Azure cloud platform. The candidate should have strong hands-on experience with Azure Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Azure Data Factory (ADF), with a solid understanding of modern data lakehouse architectures.

Key Responsibilities

  • Design and develop scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Python.
  • Build and maintain ETL/ELT pipelines for batch and large-scale data processing.
  • Develop data ingestion and transformation workflows using Azure Data Factory (ADF).
  • Design and implement Delta Lake / Lakehouse solutions.
  • Work with Azure Data Lake Storage Gen2 (ADLS Gen2) for data ingestion, storage, and processing.
  • Develop optimized PySpark and SQL transformations for large datasets.
  • Implement Delta tables, schema management, data quality checks, and performance optimization.
  • Work with Databricks Workflows/Jobs for pipeline orchestration and scheduling.
  • Implement data governance and access controls using Unity Catalog.
  • Monitor pipelines, troubleshoot failures, and optimize Spark workloads.
  • Implement CI/CD processes using Azure DevOps and Git.
  • Collaborate with Data Architects, Data Analysts, BI teams, and business stakeholders.
  • Support downstream reporting and analytics solutions such as Power BI.

Key Responsibilities

Good to Have

  • Databricks SQL
  • Structured Streaming
  • Kafka or Event Hubs
  • Power BI
  • Terraform
  • CI/CD automation
  • Data modeling
  • Data quality frameworks
  • Microsoft Fabric exposure

Skill Requirements

Experience

  • 9+ years of overall Data Engineering experience.
  • 4+years of hands-on Databricks/Spark experience preferred.
  • Experience delivering cloud-based data platforms on Microsoft Azure.

Other Requirements

Primary Skill: Azure Databricks / Data Engineering

Secondary Skills: PySpark, SQL, Python, Azure Data Factory, Delta Lake, ADLS Gen2
Maximum Salary (US):  148000
Minimum Salary (US):  100000
Apply now
Information at a Glance

Why HCLTech?

At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.

HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending June 2026 totaled $14.8 billion. 

 

Compensation and Benefits

A candidate’s pay within the range will depend on their skills, experience, education, and other factors permitted by law. This role may also be eligible for performance-based bonuses subject to company policies. In addition, this role is eligible for the following benefits subject to company policies: medical, dental, vision, pharmacy, life, accidental death & dismemberment, and disability insurance; employee assistance program; 401(k) retirement plan; 10 days of paid time off per year (some positions are eligible for need-based leave with no designated number of leave days per year); and 10 paid holidays per year.