Job Summary
Job Description – GCP Architect (pipeline creation/ 10+ years of exp/ Dataform)
🔹 Role Overview
We are looking for a skilled GCP Data Engineer to design, build, and optimize scalable data pipelines and data platforms on Google Cloud. The role involves working with large datasets, ensuring high data quality, and enabling analytics and reporting solutions across business functions.
GCP Data Engineers are typically responsible for designing and maintaining data pipelines and infrastructure using Google Cloud services to support analytics and decision-making.
🔹 Key Responsibilities
- Design, develop, and maintain scalable data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage
- Build and manage ETL/ELT workflows for structured and unstructured data
- Develop and orchestrate data pipelines using Cloud Composer (Airflow)
- Perform data ingestion, transformation, and integration across multiple source systems
- Design and implement data models and data warehouse solutions (BigQuery-based)
- Ensure data quality, validation, reconciliation, and governance
- Monitor and optimize pipeline performance, cost, and scalability
- Work closely with data scientists, analysts, and business teams to deliver data solutions
- Ensure security, compliance, and access control using IAM and best practices
Key Responsibilities
🔹 Required Skills & Experience
Technical Skills
- Strong hands-on experience with Google Cloud Platform (GCP) services:
- BigQuery
- Dataflow / Dataproc/Dataform
- Pub/Sub
- Cloud Storage
- Cloud Composer (Airflow)
- Proficiency in Python and SQL for data processing
- Experience with ETL/ELT pipelines, data modeling, and warehousing concepts
Data Engineering Capabilities
- Strong understanding of:
- Data warehousing (DWH)
- Dimensional modeling / Medallion architecture
- Data pipeline orchestration and scheduling
- Experience in batch + real-time data processing
🔹 Soft Skills
- Strong problem-solving and analytical skills
- Effective stakeholder communication and collaboration
- Ability to work in Agile / Scrum delivery models
🔹 Experience & Qualifications
- Bachelor’s/Master’s in Computer Science, Engineering, or related field
- 7+ years of experience in data engineering / cloud data platforms
- Hands-on experience in building data pipelines on GCP
🔹 Good to Have
- Experience in US Healthcare domain
Skill Requirements
Primary & Secondary Skills (Quick View)
|
Category |
Skills |
|
Primary |
GCP Data Engineering, BigQuery, Dataflow, Data Pipelines |
|
Secondary |
Python, SQL, Airflow, CI/CD |
|
Nice to Have |
Healthcare domain, Spark, ML integration |