Job Summary

Description
260500017 in CPT 
Need a Data Engineer with the following skills:


Technical Skills – Data Engineer / Professional Data Engineer (Azure,Databricks Focus)


ETL & Data Transformation: Proficient in designing and implementing robust ETL pipelines using Python and PySpark to process large-scale data efficiently. Strong experience with Azure Data Factory (ADF) for orchestrating and automating data workflows.


Database Management: Skilled in working with SQL databases, including query optimization, schema design, and data modeling to support scalable data solutions.


Azure Cloud Fundamentals: Solid understanding of core Azure services with hands-on experience in deploying and managing data solutions in the Azure ecosystem, 


API Development & Maintenance: Practical experience in developing, testing, and troubleshooting APIs, including the ability to write and fix RESTful APIs to support data integration and application needs.


Azure Functions: Experience writing serverless Azure Functions, handling their deployment, and integrating them within data pipelines and cloud architectures.

Key Responsibilities

1. To be responsible for providing technical guidance / solutions ;define, advocate, and implement best practices and coding standards for the team.
2. To develop and guide the team members in enhancing their technical capabilities and increasing productivity
3. To ensure process compliance in the assigned module| and participate in technical discussions/review as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
4. To prepare and submit status reports for minimizing exposure and risks on the project or closure of escalations.

Skill Requirements

null

Other Requirements

null