Job Summary
Senior Data Engineer: - 5-8 yrs experience
Python, Databricks, Spark, Azure, SQL, GIT, Data Governance, Data quality, API Gateway,PowerBI, Json, Shell Scripting
Key Responsibilities
· Overall 5-8 yrs of Software Development experience
· Solid Data pipeline development experience using PYTHON, Spark and Databricks
· Strong SQL experience (Oracle or MySQL)
· Strong Experience in cloud services for Azure Data Lake, Azure Lakehouse, Key vault, and other Azure services
· Experience with Dimensional Data modelling strategies and medallion architecture.
· Proficiency in Data Governance and Data quality strategies for Data pipeline development
· Hands on experience in Python, spark, SQL, API Gateways
· Hands on experience in setting up CI/CD Pipeline using tools like Git, Azure Devops and others
· Hands-on experience in writing Unit, Integration and Functional Tests.
Skill Requirements
· Overall 5-8 yrs of Software Development experience
· Solid Data pipeline development experience using PYTHON, Spark and Databricks
· Strong SQL experience (Oracle or MySQL)
· Strong Experience in cloud services for Azure Data Lake, Azure Lakehouse, Key vault, and other Azure services
· Experience with Dimensional Data modelling strategies and medallion architecture.
· Proficiency in Data Governance and Data quality strategies for Data pipeline development
· Hands on experience in Python, spark, SQL, API Gateways
· Hands on experience in setting up CI/CD Pipeline using tools like Git, Azure Devops and others
· Hands-on experience in writing Unit, Integration and Functional Tests.