Job Summary
Key Responsibilities
2. To bridge the gap between client needs and business goals by gathering requirements, crafting innovative solutions with deep domain/technology expertise, and driving successful implementations that propel strategic initiatives.
3. To ensure knowledge up-gradation and work with new technologies so that the solution is current and meets quality standards and the client requirements
4. To review architecture and design deliverables and ensure solutions adhere to industry best practices ,architectural standards simultaneously establish and enforce governance /compliance measures.
5. To train and develop team so as to ensure that there is an adequate supply of trained manpower in the said technology and delivery risks are mitigated
6. To submit Whitepapers, participate in industry forums and file Patents
Skill Requirements
Other Requirements
Mandatory skills:
AWS DevSecOps, Terraform , IAC, GitLab CI/CD, Docker, Kubernetes
Optional skills:
AWS cloudwatch, AWS Service Mesh, API Gateway , Kong
Knowledge of data lakes, Lakehouse, DWH, streaming & analytics platforms, Glue catalogs, Glue jobs is an added advantage
Key Responsibilities
• Designing scalable data lakes, Lakehouse, DWH, streaming & analytics platforms.
• Design, build and manage Glue catalogs, Glue jobs
• Architect & optimize AWS-based ETL/ELT, ML, and real-time data pipelines.
• Implement data governance, security, quality, metadata & lineage frameworks.
• Automate monitoring, scaling and governance using CloudWatch, Event Bridge and lambda.
• Own end-to-end environment Automation
• Establishing development tools and infrastructure for automation
• Understanding the needs of stakeholders and conveying this to developers
• Testing and examining code written by others and analyzing results
• Ensuring that systems are safe and secure against cybersecurity threats
• Identifying technical problems, performing root cause analysis, and developing software updates and ‘fixes’
• Working with software developers and software engineers to ensure that development follows established processes and works as intended
• Support enterprise Cloud applications or infrastructure through infrastructure as code including any activities around automated server or network configurations, large-scale software deployments, and monitoring and testing, such as CI/CD
• Document as-is state of the environment, perform a gap analysis, and produce artifacts that articulate options and recommendations
• Leverage virtualization and containerization to optimize and modernize software systems
• Act as an individual contributor and mentor team members
• Engineer and implement solutions and provide recommendations for continuous improvement for the services provided
• Present regular status updates and provide cross training to other team members.
Technical Skills required:
1. Data Ingestion Layer
• Informatica
• AWS Glue
2. Data Storage Layer and Analytics
• Amazon S3
• Amazon Redshift
3. Security & Governance
• AWS Lake Formation
• AWS IAM
• AWS KMS
3. Data Processing Layer
• AWS Glue
• Amazon Event Bridge
• Amazon SageMaker
• Amazon Athena
• Amazon SQS
• AWS Step Functions
5. Infrastructure & DevOps
• IaC: Terraform
• CI/CD: GitLab CI
• Monitoring: Amazon CloudWatch, SN
• Secrets: AWS Secrets Manager