Job Summary
We are seeking a highly skilled Senior DevOps Engineer to lead the design, automation, deployment, and operational management of enterprise-scale Azure and Databricks platforms. The ideal candidate will have deep expertise in Azure services, Databricks environments, GitHub-based CI/CD pipelines, Infrastructure as Code (IaC), and Disaster Recovery (DR) automation.
This role will be responsible for establishing standardized deployment frameworks, automating environment provisioning, implementing resilient DR strategies, and ensuring highly available, secure, and scalable cloud-native solutions that support critical business and regulatory applications.
Key Responsibilities
Cloud Platform Deployment & Automation
- Design, implement, and maintain automated CI/CD pipelines using GitHub Actions and GitHub Enterprise.
- Deploy and manage Azure services across Development, QA, UAT, and Production environments.
- Automate infrastructure provisioning using Terraform, Bicep, ARM Templates, or similar IaC tools.
- Establish deployment standards, governance controls, and reusable deployment templates.
- Implement blue-green, rolling, and zero-downtime deployment strategies.
Azure Services Management
Deploy, configure, and support:
- Azure Data Factory (ADF)
- Azure Service Bus
- Azure Web Apps
- Azure Function Apps
- Azure SQL Database / Managed Instance
- Azure Key Vault
- Azure Storage Accounts
- Azure Monitor & Log Analytics
- Azure Application Insights
- Azure Virtual Networks, Private Endpoints, NSGs
- Azure API Management
- Azure App Configuration
- Azure Entra ID (Azure AD)
Databricks Platform Engineering
Deploy and manage:
- Databricks Workspaces
- Databricks Notebooks
- Databricks Jobs
- Databricks Workflows/Pipelines
- Delta Live Tables (DLT)
- Unity Catalog
- Databricks Apps
- Databricks AI/Agent Framework Components
- Databricks Model Serving Endpoints
- Databricks Asset Bundles (DAB)
- Databricks Secrets and Cluster Policies
- Serverless and Dedicated Compute Resources
DevOps & CI/CD
- Build enterprise-grade deployment pipelines for Azure and Databricks services.
- Implement automated testing, code quality checks, security scans, and release gates.
- Manage environment promotion strategies across SDLC stages.
- Integrate GitHub pipelines with Azure and Databricks resources.
- Implement version control and release management standards.
Disaster Recovery & Business Continuity
- Design and implement active-passive or active-active DR architectures.
- Build automated DR provisioning and synchronization mechanisms.
- Automate failover and failback processes for Azure and Databricks environments.
- Develop and test DR runbooks and recovery procedures.
- Ensure compliance with defined RTO and RPO objectives.
- Conduct periodic DR drills and environment validation exercises.
Skill Requirements
Education
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Experience
- 8+ years of DevOps, Cloud Engineering, or Platform Engineering experience.
- 5+ years of hands-on Azure platform experience.
- 3+ years of hands-on Databricks platform deployment and administration experience.
- Proven experience implementing enterprise-scale CI/CD pipelines using GitHub Actions.
Technical Skills:
- Azure Data Factory (ADF)
- Azure Service Bus
- Azure Web Apps
- Azure Function Apps
- Azure SQL Database / Managed Instance
- Azure Key Vault
- Azure Storage Accounts
- Azure Monitor & Log Analytics
- Azure Application Insights
- Azure Virtual Networks, Private Endpoints, NSGs
- Azure API Management
- Azure App Configuration
- Azure Entra ID (Azure AD)
Databricks Platform Engineering
- Databricks Workspaces
- Databricks Notebooks
- Databricks Jobs
- Databricks Workflows/Pipelines
- Delta Live Tables (DLT)
- Unity Catalog
- Databricks Apps
- Databricks AI/Agent Framework Components
- Databricks Model Serving Endpoints
- Databricks Asset Bundles (DAB)
- Databricks Secrets and Cluster Policies
- Serverless and Dedicated Compute Resources