AI QUALITY ENGINEER
Quality Engineering
📍 Noida 🕐 Full-Time 🧭 2 to 4 years
THE MISSION
We aren't automating scripts — we're deprecating the era of manual-heavy testing entirely. TestMu AI is building the world's first AI-native platform where Agentic Intelligence autonomously plans, authors, and self-heals the entire Quality Engineering lifecycle.
Drive forward AI system quality by designing robust evaluation frameworks and ensuring high standards.
THE PILLARS OF IMPACT
🚀 1. Framework Design & Implementation (50%)
– Design evaluation frameworks for non-deterministic AI systems.
– Implement quality standards across AI products.
– Collaborate with teams to integrate evaluation tools.
– Ensure scalability and reliability of testing processes.
⚙️ 2. Quality Assurance (30%)
– Develop automated testing tools for AI systems.
– Monitor system performance and quality metrics.
– Identify and resolve quality issues proactively.
🧠 3. Innovation & Problem-Solving (20%)
– Explore new methodologies for AI quality evaluation.
– Innovate testing strategies for complex AI workflows.
MUST-HAVES — DO NOT APPLY UNLESS YOU HAVE THESE
– You must have strong programming fundamentals in Python or similar language.
– You must have experience with LLM evaluation frameworks.
– You must be comfortable with non-determinism and reasoning in distributions.
– You must have problem-solving skills and ability to build necessary tooling for testing.
THE BAR — WHAT YOU MUST PROVE
Experience limited to Selenium, Cypress, or Playwright UI automation.: Candidate's resume shows only UI automation experience.
Preference for predefined test cases.: Candidate expresses reliance on predefined test cases in interviews.
Definition of 'done' as 'it passed locally'.: Candidate states local pass as completion in previous roles.
Lack of experience in AI systems testing.: Resume lacks mention of AI testing projects or frameworks.
YOUR PATH
This role reports to the Head of Quality Engineering. In 12-18 months, you can advance to Senior AI Quality Engineer, leading quality initiatives and mentoring junior engineers.
Your growth at TestMu AI is mapped to what you ship - not how long you've been here.
