Job Summary

Data Engineer (Databricks) designs and maintains scalable, reliable data pipelines that transform raw data into analytics‑ready datasets for reporting and decision‑making. The role ensures high data quality, security, and performance across cloud‑based ETL workflows, while collaborating closely with analytics and business teams to enable trusted, data‑driven insights

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes
• Implement ETL processes to ingest, transform, and load data from various sources
• Ensure data quality, security, and compliance
• Optimize and fine-tune data systems for performance and scalability
• Develop and document data architecture and processes
• Collaborate with data scientists and analysts to understand data requirements
• Work closely with cross-functional teams to support data-driven decision-making
• Monitor and troubleshoot data pipeline issues
• Troubleshoot and resolve data-related issues and support users
• Monitor ETL processes, proactively identifying and resolving issues or performance bottlenecks to maintain high system reliability.
• Review data transformation and ingestion patterns, including CDC, schema evolution, and error handling for robust data operations.
• Document ETL workflows, data mappings, and process changes to ensure transparency and clear communication across technical and non-technical teams.
• Stay updated with the latest features and best practices

Skill Requirements

• Degree in Computer Science, Data Engineering, Information Technology or a related field
• A minimum of 5 years of professional experience in data engineering or a related role
• Proven experience as a Data Engineer with a focus on Databricks
• Strong programming skills in SQL and Python
• Experience with cloud computing platforms (preferably Microsoft Azure)
• Ideally Experience with data virtualization tools (Denodo or Tableau)
• Strong problem-solving and analytical skills
• Proficiency in CDC ingestion patterns (watermarks, change tables, log-based ingestion).
• Advanced error handling & observability
• Excellent communication and teamwork abilities
• A passion for working with data and a desire to continuously learn and improve
• Excellent English skills. German skills are a bonus
• Microsoft Azure or Databricks certifications are a plus

Other Requirements

4 = Enable: Performs diverse complex activities, supports and guides others, delegates tasks when appropriate, works autonomously under general direction, and contributes expertise to deliver team objectives