Job Summary
• Experience with fabric-cicd, Fabric REST APIs, Fabric Item APIs, Tabular Editor, TMDL, or similar deployment tooling.
• Databricks, Azure Data Factory, or Synapse CI/CD experience.
• Azure identity and security automation involving service principals, managed identities, workspace identities, and Key Vault.
• Infrastructure-as-code using Bicep, Terraform, or ARM templates.
• Automated testing for data pipelines, reports, notebooks, or semantic models.
• Event-driven integration using Event Hubs, Service Bus, webhooks, or similar technologies.
• Azure Monitor, Log Analytics, Application Insights, or comparable observability tooling.
• Able and willing to work across both Business Insights and SSDP, with approximately 20–30% allocation to the secondary team as priorities require.
Key Responsibilities
• Build data products on Microsoft Fabric end to end, including ingestion, Bronze, Silver, and Gold transformation, modeling, and publication.
• Develop reusable templates, parameterized pipelines, metadata-driven ingestion, notebook libraries, and delivery patterns.
• Implement data contracts, metadata standards, lifecycle controls, and ownership information.
• Contribute delivery capacity for CMD, Sales, and future domain data products, and support Business Insights with Gold-layer preparation where needed.
• Implement and operate catalog, lineage, classification, ownership, and data quality using Microsoft Purview and/or Fabric-native capabilities.
• Define and implement quality checks, validation rules, certification criteria, and operational controls.
• Build and maintain operational dashboards for platform health, pipeline reliability, refresh status, usage, incidents, and cost.
• Track SLAs and SLOs and establish incident routines, runbooks, support processes, and continuous improvement actions.
• Manage day-to-day FinOps, including Fabric capacity utilization, cost allocation, showback, anomaly detection, and optimization recommendations.
• Support onboarding of domain teams to SSDP standards and ways of working.
Skill Requirements
• Strong hands-on data engineering using PySpark or Spark, SQL, Python, pipeline orchestration, and incremental-loading patterns.
• Hands-on Microsoft Fabric experience, or strong Databricks or Synapse experience with a clear transfer path to Fabric, including Lakehouse, notebooks, pipelines, and OneLake or equivalent concepts.
• Experience building reusable pipelines and data products using frameworks and templates rather than only one-off deliveries.
• Practical governance-implementation experience involving data quality, metadata, catalog tooling, documentation, and operational controls.
• Experience with monitoring, operational reporting, platform support, and troubleshooting.
• Strong scripting and automation capability.
• Ability to work across technical teams, governance stakeholders, and business stakeholders with strong documentation discipline.
• Minimum approximately five years of relevant data-engineering experience with operations or governance exposure.