Job Summary
| • Build and Optimize ELT/ETL Pipelines using BigQuery, GCS, Dataflow, PubSub and Orchestration services Composer/Airflow • Hands-On experience in building ETL/ELT Pipelines with developing software code in Python • Experience in working with data warehouses, data warehouse technical architectures, reporting/analytic tools • Develop and implement data quality and governance procedures to ensure the accuracy and reliability of data • Demonstrate extensive skills and success in the implementation of technology projects within a professional environment, with a particular focus on data engineering • Eager to learn and explore new services within GCP to enhance skills and contribution to Projects • Demonstrated excellent communication, presentation, and problem-solving skills. • Prior Experience in ETL tool such as DBT,Talend Etc Good to have skills • AI/ML,Gen AI Backgroud • IAM, Cloud Logging and Monitoring • The Data Engineer coaches the junior data engineering personnel position by bringing them up to speed and help them get better understanding of overall Data ecosystem. • Working Experience with Agile methodologies and CI/CD Tools like Terraform/Jenkins • Working on Solution deck, IP build, client meetings on requirement gathering |
| Technical / Functional Skills:- • Knowledge in architecture principles, guidelines and standards • Data Warehousing • Programming Language: Python, SQL • Big Data • Data Analytics • Experience in Building Streaming and Batch data pipelines with GCP services Experience in designing & implementing solution in mentioned areas: Cloud Storage, BigQuery, Data Flow, DataProc, PubSub,Data Fusion,Cloud Function,Composer etc |
Key Responsibilities
2. Collaborate with cross functional teams to define technical solutions and architecture for gcp projects.
3. Conduct code reviews, ensure code quality, and provide technical guidance to the development team.
4. Troubleshoot and resolve complex technical issues related to gcp application development.
5. Stay updated on the latest gcp services, features, and best practices to optimize application performance.
6. Implement security measures and compliance standards in gcp applications.
7. Mentor junior team members and foster a culture of continuous learning and development within the team.
Skill Requirements
2. Experience with programming languages like python, java, or node.js for gcp application development.
3. Strong understanding of microservices architecture, containers, and container orchestration tools like kubernetes on gcp.
4. Handson experience in designing and implementing restful apis and integrating third-party services on gcp.
5. Knowledge of ci/cd pipelines, automation tools, and infrastructure as code (iac) on gcp.
6. Excellent problem-solving skills and the ability to work effectively in a fast paced, collaborative environment.
7. Strong communication skills to interact with stakeholders, present technical solutions, and lead discussions on gcp application development strategies.