Job Summary
Job Title : Data QA Engineer (GCP / BigQuery)
Job Summary
We are seeking a Data QA Engineer to validate the correctness of data engineering solutions built on Google Cloud Platform (GCP). The role is focused on testing ETL/ELT pipelines, data transformation logic, and data processing workflows by comparing outputs against expected reference datasets and verifying that implemented business rules produce the expected results.
The role is strictly focused on quality assurance and test automation for data engineering deliverables. It does not involve data cleansing, data quality remediation, or production data support.
Key Responsibilities
- Validate ETL/ELT pipelines, transformation logic, and data processing workflows.
- Develop SQL-based test cases and reconciliation queries using BigQuery.
- Compare outputs from new pipelines and transformations against trusted reference datasets.
- Perform source-to-target validation, regression testing, and functional testing of data engineering artifacts.
- Design, develop, and maintain automated test scripts and reusable validation frameworks using Python.
- Execute test plans, record test results, and report defects with sufficient evidence for resolution by development teams.
- Collaborate with Data Engineers to clarify requirements, validate fixes, and ensure successful delivery.
- Contribute to the continuous improvement of QA processes, automation frameworks, and testing standards.
Required Skills
- Strong SQL expertise with hands-on experience in BigQuery.
- Strong Python programming skills for test automation.
- Experience with Google Cloud Platform (GCP), including BigQuery and GCS; exposure to Cloud Composer, Dataflow, or Dataproc is desirable.
- Strong understanding of ETL/ELT processes, data transformations, and data warehousing concepts.
- Familiarity with Backend Kafka and API
- Experience in data validation, reconciliation testing, and regression testing.
- Familiarity with Git, CI/CD pipelines, and automated testing frameworks.
Experience
- 6 – 10 years of experience in Data QA, ETL Testing, or Data Test Automation.
- Experience testing cloud-based data engineering solutions, preferably on GCP.
Key Competencies
- SQL and analytical skills
- Test automation using Python
- Defect identification and reporting
- Problem-solving
- Collaboration and communication
- Quality assurance mindset
Key Responsibilities
Job Title : Data QA Engineer (GCP / BigQuery)
Job Summary
We are seeking a Data QA Engineer to validate the correctness of data engineering solutions built on Google Cloud Platform (GCP). The role is focused on testing ETL/ELT pipelines, data transformation logic, and data processing workflows by comparing outputs against expected reference datasets and verifying that implemented business rules produce the expected results.
The role is strictly focused on quality assurance and test automation for data engineering deliverables. It does not involve data cleansing, data quality remediation, or production data support.
Key Responsibilities
- Validate ETL/ELT pipelines, transformation logic, and data processing workflows.
- Develop SQL-based test cases and reconciliation queries using BigQuery.
- Compare outputs from new pipelines and transformations against trusted reference datasets.
- Perform source-to-target validation, regression testing, and functional testing of data engineering artifacts.
- Design, develop, and maintain automated test scripts and reusable validation frameworks using Python.
- Execute test plans, record test results, and report defects with sufficient evidence for resolution by development teams.
- Collaborate with Data Engineers to clarify requirements, validate fixes, and ensure successful delivery.
- Contribute to the continuous improvement of QA processes, automation frameworks, and testing standards.
Required Skills
- Strong SQL expertise with hands-on experience in BigQuery.
- Strong Python programming skills for test automation.
- Experience with Google Cloud Platform (GCP), including BigQuery and GCS; exposure to Cloud Composer, Dataflow, or Dataproc is desirable.
- Strong understanding of ETL/ELT processes, data transformations, and data warehousing concepts.
- Familiarity with Backend Kafka and API
- Experience in data validation, reconciliation testing, and regression testing.
- Familiarity with Git, CI/CD pipelines, and automated testing frameworks.
Experience
- 6 – 10 years of experience in Data QA, ETL Testing, or Data Test Automation.
- Experience testing cloud-based data engineering solutions, preferably on GCP.
Key Competencies
- SQL and analytical skills
- Test automation using Python
- Defect identification and reporting
- Problem-solving
- Collaboration and communication
- Quality assurance mindset