Senior Technical Lead
Senior Technical Lead
Job Summary
About the role
You will join the PL Data Readiness team, a business-oriented group with great energy. You will help produce data products for production supply chain, a fast-growing area. You will work with the latest data engineering technologies in an international, collaborative environment.
This role is offered as a consultant assignment. There is potential for a longer-term opportunity for the right candidate.
Key Responsibilities
Design, develop and optimize data pipelines and workflows using Azure Databricks, Spark, Python and SQL.
Develop and maintain data products exposed through Unity Catalog.
Deploy and manage Databricks workloads as code using Declarative Automation Bundles (formerly Databricks Asset Bundles, DAB).
Work closely with business analysts and data architects to turn requirements into technical solutions.
Ensure data quality, security and compliance.
Continuously improve the performance, cost-efficiency and scalability of data systems.
Required Skills & Qualifications
Strong expertise in Azure Databricks, Spark and Python (must-have).
Strong SQL skills, including complex queries, transformations and performance tuning (must-have).
Experience with Declarative Automation Bundles (DAB).
Solid experience with Unity Catalog and ADLS Gen2.
Solid understanding of ETL/ELT, data modeling and data architecture principles.
Familiarity with CI/CD pipelines and Git.
Strong problem-solving skills and a structured way of working in an agile delivery model.
Excellent communication skills. You enjoy working with business stakeholders and cross-functional teams.
Nice-to-Have Skills
Experience with dbt, preferably dbt-databricks.
Experience packaging Python code as wheel packages.
Experience working with APIs (REST or equivalent).
Experience with Structured Streaming in Databricks.
Knowledge of data governance, lineage and security best practices.
Exposure to Power BI or similar visualization tools.
Key Responsibilities
About the role
You will join the PL Data Readiness team, a business-oriented group with great energy. You will help produce data products for production supply chain, a fast-growing area. You will work with the latest data engineering technologies in an international, collaborative environment.
This role is offered as a consultant assignment. There is potential for a longer-term opportunity for the right candidate.
Key Responsibilities
Design, develop and optimize data pipelines and workflows using Azure Databricks, Spark, Python and SQL.
Develop and maintain data products exposed through Unity Catalog.
Deploy and manage Databricks workloads as code using Declarative Automation Bundles (formerly Databricks Asset Bundles, DAB).
Work closely with business analysts and data architects to turn requirements into technical solutions.
Ensure data quality, security and compliance.
Continuously improve the performance, cost-efficiency and scalability of data systems.
Required Skills & Qualifications
Strong expertise in Azure Databricks, Spark and Python (must-have).
Strong SQL skills, including complex queries, transformations and performance tuning (must-have).
Experience with Declarative Automation Bundles (DAB).
Solid experience with Unity Catalog and ADLS Gen2.
Solid understanding of ETL/ELT, data modeling and data architecture principles.
Familiarity with CI/CD pipelines and Git.
Strong problem-solving skills and a structured way of working in an agile delivery model.
Excellent communication skills. You enjoy working with business stakeholders and cross-functional teams.
Nice-to-Have Skills
Experience with dbt, preferably dbt-databricks.
Experience packaging Python code as wheel packages.
Experience working with APIs (REST or equivalent).
Experience with Structured Streaming in Databricks.
Knowledge of data governance, lineage and security best practices.
Exposure to Power BI or similar visualization tools.