Job Summary
Description:
Build and operate scalable data pipelines and data products on an Azure lakehouse, using strong engineering practices and high ownership.
Must have
familiar with data warehousing, modeling, lakehouse concepts, data formats and security
excellent SQL skills
good python skills
databricks experience
very familiar with Git, CI/CD, shell programming and software engineering best practices
Nice to have
dbt
spark declarative pipelines
Power BI (semantic model and modeling)
Soft skills
Analytical mindset, Proactive, independent, excellent communicator, continuous improvement mindset, ownership, drive to take on new challenges and move topics forward.
Tech stack
Azure, Azure DevOps, Databricks (Unity Catalog, automation bundles), dbt, PySpark, Power BI, Power Automate, MQ, Qliksense
Key Responsibilities
2. To develop and guide the team members in enhancing their technical capabilities and increasing productivity
3. To ensure process compliance in the assigned module| and participate in technical discussions/review as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
4. To prepare and submit status reports for minimizing exposure and risks on the project or closure of escalations.