Job Summary
Key Responsibilities
Preferred Qualifications
- Certifications in cloud platform (GCP Professional Data Engineer) is a plus.
Key Responsibilities
- Provide engineering expertise to the team for developing features for Banking including Financial Crimes, Anti-money Laundering platforms.
- Improve engineering practices, including driving resilience, predictability, and end efficiency through automation.
- Partner with product teams to envision and deliver solutions which transform Financial Crimes Compliance using technology.
Skill Requirements
Technical Skills
- GCP Cloud - Big Query, Airflow, DataProc, PubSub.
- Hadoop Hive, Spark, Python, shell scripting.
- Strong experience in designing, developing, and optimizing data pipelines for large-scale data processing, transformation, and analysis using Big Data and GCP technologies.
- Proficiency in SQL and database systems, with experience in designing and optimizing data models for performance and scalability.
- Experience of building event processing pipelines with Kafka or GCP PubSub.
- Design and development experience with Airflow, PubSub Kafka, Git, Jenkins is desirable.
- Knowledge of distributed (multi-tiered) systems, algorithms & relational databases.
- Strong Object-Oriented Programming skills and design patterns.
- Experience with CICD pipelines, Automated test frameworks, and source code management tools (XLR, Jenkins, Git).
- Good knowledge and experience with configuration management tools like GitHub.
Other Requirements
Problem Solving & Engineering
- Ability to analyze complex data engineering problems, propose effective solutions, and implement them effectively.
- Ability and willingness to learn, adopt and build solutions using the Enterprise frameworks established for Big Data.
- Looks proactively beyond the obvious for continuous improvement opportunities.
Communication & Collaboration
- Communicates effectively with product and cross functional team.
- Willingness to learn new technologies and leverage them to their optimal potential.
- Understanding of various SDLC methodologies, familiarity with Agile & scrum ceremonies.