Job Summary
Data Platform Developer
To be successful as a Data Platform developer you should have experience with:
Hands on coding experience preferably on Python
Strong knowledge and hands-on experience of AWS development including some of the following : Lambda, Glue, Step Functions, IAM roles, Lakeformation,
EventBridge, SNS, SQS, EC2,Security Groups, CloudFormation, RDS, DynamoDB, Redshift
Experience in building efficient data pipelines using Apache Spark and AWS services
Strong technical acumen with the ability to quickly understand complex systems, troubleshoot issues and apply sound engineering principles to solve problems
A proactive learner who stays up to date with new technologies and continuously seeks to improve their skills and understanding
Some other highly valued skills include:
Proven ability to design and develop enterprise level software solutions using tools and techniques such as Source Control, Build Tools (e.g. Maven), TDD, Jenkins etc.
Demonstrable working knowledge on different file formats JSON, Iceberg, Avro
Knowledge of Streaming services is preferable (Kafka , MSK , Kinesis , Glue Streaming etc.)
Communication and Collaboration: Ability to communicate effectively with cross-functional teams and stakeholders. Documenting configurations, processes, and best practices for the team.
BigData / Data Warehouse experience
Worked in Financial services domain.
Key Responsibilities
2. To conduct comprehensive code reviews, establish and oversee quality assurance processes, performance optimization , implementation of best practices and coding standards to ensure successful delivery of complex projects.
3. To ensure process compliance in the assigned module| and participate in technical discussions/review as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
4. To collaborate with stakeholders to define project scope, objectives, deliverables and accordingly prepare and submit status reports for minimizing exposure & closure of escalations.