Job Summary
We are seeking a highly skilled and experienced Data/BI Engineer to join our Data Analytics team. The ideal candidate will have a comprehensive understanding of data lake/data warehouse concepts, extensive experience with cloud-based data platforms, and a proven ability to design, build, maintain, and optimize data pipelines. Additionally, they should possess expertise in data modeling, Snowflake, and DBT to effectively manage, transform, and analyze data within the data warehouse.
Key Responsibilities
Responsibilities:
- Collaborate with business and data analysts to understand data requirements, develop data solutions, and translate business needs into technical specifications
- Design, build, and maintain data pipelines to seamlessly transfer data from source systems to data warehouses and data lakes
- Monitor and troubleshoot data pipeline performance, optimize data processing efficiency, and identify performance bottlenecks
- Designing data layers in data warehouse as per industry standards . Data modeling as per Kimball’s standards and come out with performance effective data design.
- Implement data quality and data governance processes to maintain the accuracy and reliability of data
- Stay up-to-date on the latest data technologies and trends, particularly in the realm of data modeling, cloud-based data platforms, and data transformation tools
Skill Requirements
Qualifications:
- Bachelor's degree in computer science, engineering, or a related field
- Minimum of 10+ years of experience in data engineering or a related field
- In-depth understanding of data lake/data warehouse concepts, data modeling principles, and data transformation methodologies
- Proven experience with cloud-based data platforms
- Proficient in Snowflake, including data modeling, data warehousing, and data engineering
- Expertise in DBT, demonstrating the ability to design, develop, and maintain SQL-based data transformations
- Familiarity with programming languages such as SQL
- Excellent communication and collaboration skills, fostering a collaborative environment and effective knowledge sharing
- Strong analytical mindset, with the ability to solve complex data-related problems and identify potential issues proactively
Skill Mandatory/Optional Expected score for project
(out of 10) Remarks
Problem statement, solutioning/ consulting, Analytics Mandatory 7
Data warehouse knowledge Mandatory 7
Azure (cloud knowledge & Azure components) Mandatory 6
ADF Mandatory 7
Snowflake Mandatory 5
SQL Mandatory 8
DBT Optional 7
Data modeling Mandatory 7
Source control (Github) Mandatory 7
Azure Devops Optional 5
Power BI Optional 7 Will be given preference to those profiles having this skill
Soft skills Mandatory 7
Agile delivery methodology Optional 5