Job Summary
Seeking a DP-700 certified Microsoft Fabric Data Engineers to design, build, and optimize end-to-end data engineering solutions on Microsoft Fabric. The role focuses on data ingestion and transformation, security and governance, and monitoring/performance optimization for analytics solutions. You will collaborate with architects, analytics engineers, analysts, and platform administrators to deliver reliable, scalable data pipelines and lakehouse/warehouse solutions.
Key Responsibilities
- Design and implement batch and streaming ingestion patterns into Fabric data stores (e.g., lakehouse/warehouse/KQL as applicable), ensuring accuracy, reliability, and scalability
- Build and optimize transformations using PySpark/Python, SQL, and KQL for data preparation and analytics-ready outputs.
- Develop orchestration and integration workflows leveraging Azure/Synapse ecosystem capabilities (e.g., Serverless SQL, Dedicated SQL, ADF/ADLS patterns) as required by the solution architecture.
- Implement security, governance, and access controls aligned to enterprise standards; ensure compliant handling of data across the analytics platform.
- Monitor workloads, troubleshoot failures, and continuously optimize performance and cost (query tuning, compute/resource efficiency, pipeline reliability)
- Apply engineering best practices: modular design, reusable frameworks, parameterization, validation checks, and operational runbooks
- Maintain version control and collaboration workflows using GitHub (branching, PR reviews, tagging/release discipline; CI/CD where applicable)
- Work in an agile delivery model: contribute to estimations, participate in technical discussions, and communicate progress/risks to stakeholders.
Skill Requirements
- Microsoft Fabric (DP-700 certification required - Fabric Data Engineer Associate)
- PySpark
- KQL (Kusto Query Language)
- Azure Synapse Analytics - Serverless SQL and Dedicated SQL
- Azure Data Factory (ADF)
- Python
- SQL
- Azure Data Lake Storage (ADLS Gen2)
Other Requirements
DP-700 certification required - Fabric Data Engineer Associate