Job Summary
Job Summary : Job Description • Design and execute test strategies for MCP server endpoints, AI reasoning layer, and Streamlit UI • Build automated regression suites for LLM output quality, accuracy, and consistency • Validate RAG pipeline responses against runbook ground truth and baseline thresholds • Perform API contract testing for DB Run, ServiceNow, and MCP tool integrations • Conduct performance and load testing for multi-agent orchestration workflows • Manage test environments and coordinate with GCP DevOps for CI/CD test gates
Job Responsibilities : Job Description • Design and execute test strategies for MCP server endpoints, AI reasoning layer, and Streamlit UI • Build automated regression suites for LLM output quality, accuracy, and consistency • Validate RAG pipeline responses against runbook ground truth and baseline thresholds • Perform API contract testing for DB Run, ServiceNow, and MCP tool integrations • Conduct performance and load testing for multi-agent orchestration workflows • Manage test environments and coordinate with GCP DevOps for CI/CD test gates
Job Description : Coordinate with multiple stakeholders.
Key Responsibilities
NA
Skill Requirements
Skill Requirement : Skills Required • Test automation: pytest, Selenium, Playwright • API testing: Postman, REST-assured, FastAPI test client • Python scripting for test harness development • CI/CD integration: GitHub Actions, Jenkins pipelines • Performance testing: Locust, k6, JMeter • AI/LLM output validation and regression testing • Docker, Kubernetes basics for test Environments
Other Requirements
Other Requirement : Coordinate with multiple stakeholders.