The posting
Evolver builds enterprise AI that works inside some of the most demanding functions in large organizations, including tax, finance, and procurement. Our customers make real decisions based on what our platform produces, so quality here is not a final checkpoint. It is part of the product.
We are seeking a hands-on Senior QA Lead to define how Evolver tests, measures, and ships with confidence. You will lead our QA team in India, currently two engineers, and help grow it to five over the coming months. You will partner closely with GenAI Engineering, Product, and our Forward Deployed Engineers to build a quality practice that covers traditional application testing as well as the harder questions that come with AI: consistency, accuracy, regressions in model behavior, and how a system performs on messy, real customer data.
This role is well suited for an experienced QA leader who still enjoys writing tests, wants to shape a function rather than inherit one, and is curious about what quality engineering looks like for AI products.
Key Responsibilities
Quality Strategy & Ownership
- Own Evolver's end to end quality strategy across our enterprise AI platform and customer deployments.
- Define test plans, release criteria, and quality standards for new features, integrations, and model updates.
- Decide what gets automated, what gets tested manually, and what gets monitored in production.
- Serve as the clear voice on release readiness, including when something is not ready to ship.
Testing AI Systems
- Design approaches for testing LLM powered features where outputs are not fully deterministic.
- Partner with GenAI Engineers to build evaluation sets, regression suites, and benchmarks that catch changes in model behavior.
- Validate system performance on realistic enterprise data, including edge cases, incomplete inputs, and domain specific scenarios from customer engagements.
- Help define how accuracy, consistency, and reliability are measured and reported.
Automation & Infrastructure
- Build and maintain test automation frameworks for APIs, backend services, data pipelines, and user facing applications.
- Integrate automated testing into CI/CD so quality checks run on every meaningful change.
- Improve test coverage, reliability, and speed so engineering can ship often without fear.
- Write tests yourself. This is a hands-on leadership role.
Team Leadership & Growth
- Lead and mentor our QA team in India, currently two engineers.
- Partner with the hiring team to grow the team to five, including defining roles, interviewing, and onboarding.
- Set clear expectations, review work, and build a team culture of ownership and attention to detail.
- Create processes that work across U.S. and India time zones
Cross Functional Collaboration
- Work closely with Engineering, Product, and Forward Deployed Engineers to bring quality into the process from the start, not just the end.
- Translate customer issues and field feedback into test cases and preventive improvements.
- Communicate quality status, risks, and tradeoffs clearly to technical and non-technical stakeholders.
Qualifications
Experience
- 8+ years of experience in software quality assurance or quality engineering.
- Experience leading, mentoring, or managing QA engineers, including setting standards and reviewing their work.
- Strong hands-on experience building test automation frameworks (for example, Pytest, Playwright, Selenium, Cypress, or similar).
- Proficiency in Python or another modern programming language.
- Experience testing APIs, backend services, and data heavy applications.
- Experience integrating testing into CI/CD pipelines.
- Experience working with distributed or offshore teams across time zones.
- Exposure to testing AI, ML, or LLM based products is a strong plus
Preferred
- Experience at a startup or high growth company where you built QA processes from an early stage.
- Experience testing enterprise B2B software, especially in regulated or data sensitive domains such as finance, tax, or compliance.
- Familiarity with cloud environments, particularly Azure.
- Experience with performance, security, or data quality testing.
Education
Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
This is not a manual testing position, and it is not a people manager role that has stepped away from the work. You will not be handed a finished test plan and asked to execute it.
The Senior QA Lead is a builder. You will write automation, design how we evaluate AI behavior, and make judgment calls on release readiness, while also growing and leading a team. Some weeks will look like deep technical work. Others will look like hiring, mentoring, and aligning teams across two continents.
If you have spent your career testing deterministic software and want to take on a harder and more interesting version of the problem, we would love to talk.
