Job Summary
Mandatory Technical Skills
-
- Ability to be forward-thinking and be able to analyse and anticipate project, technology and team solutions to ensure successful project delivery
- Ability to take ownership of a technical solution, build new things without needing close supervision, learn and apply new tools and technologies, solve problems without needing constant help, make consistent daily progress on design and build.
- Directly involved in driving a Data Mesh architecture / design
- Hand-on Databricks expertise
- Hands-on experience with ETL tools such as AWS Glue / DBT
- Strong knowledge of AWS services ( Lambda, Glue, ECS, Step Functions, IAM roles, Lakeformation, EventBridge, SNS, SQS, EC2,Security Groups, Cloudformation, VPC, Cloud Watch, AWS Auto Scaling, Cloud Trail, Service Catalog,Fargate)
- Promotes an automated deployment approach through dev/ ops pipelines. Ideally using Gitlab
- Demonstrable working knowledge on different file formats like XML,JSON, Parquet, Iceberg, AVRO.
- Hands-on experience in developing applications using Python/ PySPARK
- Understanding of core AWS services, uses, and AWS architecture best practices with in-depth Knowledge of AWS cloud service like Compute, Network, Storage and Identity & access management.
- Exposure working with Data Warehousing / Big Data applications.
- Experience with event driven and real time architecture patterns, messaging and streaming technologies such as Kafka, Kinesis and AWS Managed Services for Kafka.
- Education Qualification
- Graduated preferably with a technology based degree
Key Responsibilities
2. To conduct comprehensive code reviews, establish and oversee quality assurance processes, performance optimization , implementation of best practices and coding standards to ensure successful delivery of complex projects.
3. To ensure process compliance in the assigned module| and participate in technical discussions/review as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
4. To collaborate with stakeholders to define project scope, objectives, deliverables and accordingly prepare and submit status reports for minimizing exposure & closure of escalations.