Job Summary
The Senior Technical Lead will be responsible for leading the technical aspects of projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and maintaining data pipelines and ETL processes while ensuring high performance and scalability of data solutions.
Data EngineerPrimary Skills ( Must Have)Secondary Skills ( Good to have)Expertise with Python/pyspark frameworks/librariesExpertise of ADFExpertise of ADBRead and understand database execution plansExpertise of SQLAzure/azure DevOps knowledgeDesigning and implementing complex ETL and process flowsConfiguration Management, Continuous Integration, Continuous Deployment and Cloud Implementations on azureExpertise across data transformation (ETL) frameworksAzure certifiedUnderstanding of the underlying systems (storage, processing, visualization)
Key Responsibilities
2. Design and develop efficient and reliable etl processes for large datasets.
3. Collaborate with cross functional teams to understand business requirements and translate them into technical solutions.
4. Optimize data workflows, troubleshoot issues, and ensure data quality and integrity.
5. Implement best practices for data security, governance, and compliance.
6. Provide technical guidance, mentoring, and support to junior team members.
7. Stay uptodate with the latest trends and technologies in data engineering and analytics.
Skill Requirements
2. Strong skills in writing complex sql queries for data manipulation and analysis.
3. Experience with oracle pl/sql for database development and management.
4. Proficient in python programming language for automation and scripting tasks.
5. Solid understanding of data warehousing concepts, etl processes, and data modeling.
6. Ability to work in a fast paced environment and manage multiple priorities effectively.
7. Excellent problem-solving skills and attention to detail.
8. Strong communication and interpersonal skills for effective collaboration with team members and stakeholders.