Senior Test Lead
India
Apply now
Job Description
Senior Test Lead
Pune, Maharashtra

Job Summary

Design and execute testing strategies for AI/LLM systems with strong grounding in LLM testing concepts.
Validate and evaluate LLM outputs using frameworks such as DeepEval, RAGAS, TruLens, and LangSmith.
Perform prompt validation, optimization, and robustness testing across diverse use cases.
Detect, analyze, and mitigate hallucinations to ensure response accuracy and reliability.
Assess quality, bias, and performance of LLM-driven applications in production-like scenarios.
Support validation of multi-agent AI systems and contribute to continuous quality improvements.

Key Responsibilities

Define and execute test strategies for AI/LLM‑based applications.
Validate LLM responses using evaluation frameworks (DeepEval, RAGAS, TruLens, LangSmith).
Perform prompt validation, robustness testing, and regression testing for LLM workflows.
Identify, analyze, and mitigate hallucinations, bias, and response inconsistencies.
Ensure quality, accuracy, and reliability of LLM outputs across business scenarios.
Support testing and validation of multi‑agent AI systems where applicable.

Skill Requirements

Skill

Mandatory

Proficiency Level (1-5)

AI/LLM Testing concepts

Must Have

4–5

LLM evaluation frameworks (DeepEval, RAGAS, TruLens, LangSmith),

Must Have

4

Prompt validation & testing

Must Have

4–5

Hallucination detection

Must Have

4

Multi-agent system validation

Good to Have

3–4

 

Other Requirements

null
Apply now
Information at a Glance

Why HCLTech?

At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.

HCLTech is a global technology company, home to more than 226,300 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2025 totaled $14.5 billion.
23 Benefits At HCLTech, we believe in empowering our employees with comprehensive benefits that support their professional growth and enhance their well-being. When you sign up for a career with us, you gain access to: https://rmkcdn.successfactors.com/147eb21f/a701dca9-f32d-4fc9-9447-6.svg Industry-benchmarked compensation https://rmkcdn.successfactors.com/147eb21f/b0c54381-ddcc-4a33-9b35-9.svg Best-in-class healthcare benefits https://rmkcdn.successfactors.com/147eb21f/b73027be-7aae-4d36-a090-4.svg Personal time off https://rmkcdn.successfactors.com/147eb21f/d5b4fdfd-2e99-4e26-9878-9.svg Maternity and paternity benefits https://rmkcdn.successfactors.com/147eb21f/3d42b0fc-4652-435a-9ece-c.svg Access to skills / higher education programs/resources https://rmkcdn.successfactors.com/147eb21f/aeddeaf2-9e25-4584-ad11-d.svg Discounts on products and services via Benefit Box https://rmkcdn.successfactors.com/147eb21f/a9609a3b-2700-4b3c-9d90-a.svg Participate in CSR programs and live life with a purpose https://rmkcdn.successfactors.com/147eb21f/c6e33851-710f-4634-bd69-f.svg Opportunities to grow and advance your career Note: The benefits listed above vary depending on the nature of your employment and the country where you work. Some benefits may be available in some countries but not in all.