Job Summary
Overview of the Role
As a Data Lake Support Specialist (Databricks & DBT), you will ensure the operational stability of data lake environments for life sciences clients. Your focus will be on incident management, data pipeline troubleshooting, and maintaining high availability of analytics platforms.
Detailed Responsibilities
• Provide L2/L3 support for Databricks and DBT-based data lake solutions, ensuring high availability.
• Manage incidents, service requests, and changes using ServiceNow, following ITIL best practices.
• Monitor data pipeline health using Dynatrace and BigPanda, identifying failures and bottlenecks.
• Troubleshoot data pipeline failures, transformation errors, and data quality issues.
• Collaborate with data engineering teams to escalate complex issues and coordinate fixes.
• Document known issues, troubleshooting guides, and operational procedures in Confluence.
• Track support activities in JIRA, ensuring SLA adherence and timely resolution.
• Perform routine maintenance and basic automation using shell scripts, SQL, and Python.
• Coordinate with cloud infrastructure teams for AWS/Azure-related issues.
• Participate in on-call support rotations and incident bridges.
Key Responsibilities
2. To conduct comprehensive code reviews, establish and oversee quality assurance processes, performance optimization , implementation of best practices and coding standards to ensure successful delivery of complex projects.
3. To ensure process compliance in the assigned module| and participate in technical discussions/review as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
4. To collaborate with stakeholders to define project scope, objectives, deliverables and accordingly prepare and submit status reports for minimizing exposure & closure of escalations.
Skill Requirements
Skill Requirements
• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 2+ years of experience in data platform support or IT operations.
• Strong understanding of ITSM processes (ITIL certified preferred) and experience with ServiceNow.
• Proficiency with Dynatrace, BigPanda, or similar monitoring tools.
• Experience with JIRA for ticket management and Confluence for documentation.
• Basic shell scripting, SQL, and Python skills for troubleshooting.
• Foundational knowledge of AWS and Azure cloud platforms.
• Basic understanding of Databricks, DBT, and data engineering concepts is a plus.
• Excellent communication and collaboration skills.
• Exposure to GenAI technologies and Gemini for AI-assisted operations and automation is a plus.