Job Summary
| • Build and Optimize ELT/ETL Pipelines using BigQuery, GCS, Dataflow, PubSub and Orchestration services Composer/Airflow • Hands-On experience in building ETL/ELT Pipelines with developing software code in Python • Experience in working with data warehouses, data warehouse technical architectures, reporting/analytic tools • Develop and implement data quality and governance procedures to ensure the accuracy and reliability of data • Demonstrate extensive skills and success in the implementation of technology projects within a professional environment, with a particular focus on data engineering • Eager to learn and explore new services within GCP to enhance skills and contribution to Projects • Demonstrated excellent communication, presentation, and problem-solving skills. • Prior Experience in ETL tool such as DBT,Talend Etc Good to have skills • AI/ML,Gen AI Backgroud • IAM, Cloud Logging and Monitoring • The Data Engineer coaches the junior data engineering personnel position by bringing them up to speed and help them get better understanding of overall Data ecosystem. • Working Experience with Agile methodologies and CI/CD Tools like Terraform/Jenkins • Working on Solution deck, IP build, client meetings on requirement gathering |
| Technical / Functional Skills:- • Knowledge in architecture principles, guidelines and standards • Data Warehousing • Programming Language: Python, SQL • Big Data • Data Analytics • Experience in Building Streaming and Batch data pipelines with GCP services Experience in designing & implementing solution in mentioned areas: Cloud Storage, BigQuery, Data Flow, DataProc, PubSub,Data Fusion,Cloud Function,Composer etc |
Key Responsibilities
2. Collaborate with cross functional teams to understand business needs and translate them into technical requirements.
3. Ensure the performance, security, and reliability of applications on gcp.
4. Troubleshoot and resolve technical issues related to gcp application development.
5. Stay updated with the latest trends and best practices in gcp to optimize application development processes.
Skill Requirements
2. Strong programming skills in languages commonly used for gcp application development, such as python, java, or node.js.
3. Experience with developing and deploying scalable and resilient applications on gcp.
4. Knowledge of cloud security principles and best practices for securing applications on gcp.
5. Good understanding of devops practices and tools for gcp application deployment and automation.