Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 10 hours ago

Senior QA AI Engineer

Jobgether3,797 open roles

Where
India
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSenior QA AI EngineerJobgether · India

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Jobgether's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

7.9% of postings close within 7 days. Measured by our own scanner across the market. Jobgether postings stay open a median of 5 days.

Share of postings closed within
  1. 1.6%1 day
  2. 3.6%3 days
  3. 7.9%7 days
  4. 14.9%14 days
  5. 34.2%30 days
This job: posted 10 hours ago

Jobgether median: 5 days open

The posting

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior QA AI Engineer based in India.

This role leads quality engineering and AI testing initiatives for reliable, scalable, and secure cloud-based software solutions. You will design advanced testing strategies for backend services, APIs, AI-powered features, and microservices architectures. A key focus will be validating large language model behavior, agentic AI workflows, security risks, and non-deterministic outputs. You will build automated evaluation frameworks that integrate quality controls directly into modern CI/CD pipelines. Working closely with product, engineering, and machine learning teams, you will influence requirements, release quality, and technical standards. The role also provides an opportunity to mentor engineers and drive continuous improvements in quality engineering practices. You will contribute to responsible AI adoption while helping deliver resilient technology for complex risk and decision-making environments.

Accountabilities:

  • Lead quality engineering and AI testing initiatives to ensure software solutions are reliable, scalable, secure, and production-ready across cloud-based platforms.
  • Design, develop, and maintain automated test suites for Java-based backend services and REST APIs, supporting consistent quality across development and release cycles.
  • Own testing strategies for AI-powered features, including large language model output validation, regression baselines, tool-call accuracy, context management, and end-to-end integration testing.
  • Develop continuous integration evaluation frameworks for non-deterministic AI outputs using rubric-based scoring, automated prompt regression suites, and behavioral drift detection.
  • Collaborate with product owners, software engineers, and machine learning engineers to establish testable requirements, review acceptance criteria, and maintain quality throughout agile delivery cycles.
  • Perform database validation against PostgreSQL and Microsoft SQL Server to verify data integrity, transformation logic, and backend workflow accuracy.
  • Conduct AI-focused security testing, including prompt injection assessments, adversarial input validation, jailbreak testing, and sensitive data leakage checks.
  • Define and enforce synthetic or masked test-data standards for AI testing, ensuring confidential and regulated information is handled appropriately.
  • Monitor and report quality, performance, and AI observability metrics, including token consumption, streaming latency, tool-call success rates, model error rates, and reliability indicators.
  • Integrate automated testing into CI/CD pipelines and establish effective quality gates and deployment controls.
  • Conduct test-code reviews, mentor quality engineering team members, perform exploratory testing, and continuously improve testing processes and methodologies.
  • Support performance and load testing for cloud-native SaaS platforms hosted on AWS and Microsoft Azure, validating scalability, availability, and reliability.
  • Maintain comprehensive test documentation, traceability matrices, defect analysis reports, and quality metrics to provide transparency and alignment across stakeholders.
  • 5–7 years of experience in software quality engineering, with strong hands-on experience testing Java-based backend services and REST APIs.
  • Proficiency with test automation frameworks such as Selenium, TestNG, JUnit, RestAssured, or Cucumber for UI and API testing.
  • Strong knowledge of relational databases, particularly PostgreSQL and Microsoft SQL Server, with experience performing data validation and integrity testing.
  • Hands-on experience testing AI features integrated with large language models, including output validation, semantic evaluation, hallucination detection, regression testing, and streaming API behavior.
  • Familiarity with Model Context Protocol (MCP) and agentic AI testing patterns, including tool-use accuracy, context management, and validation of deterministic versus non-deterministic outputs.
  • Experience conducting AI security testing, including prompt injection, jailbreak validation, adversarial testing, sensitive data leakage assessments, and reliability or performance testing.
  • Strong understanding of software design principles, microservices architectures, and system-level test strategy development.
  • Demonstrated ability to identify complex edge cases and translate technical requirements into comprehensive quality strategies.
  • Strong understanding of AI technologies and experience applying AI tools to support innovation, operational efficiency, and responsible AI adoption.
  • Knowledge of AI risk management, governance, and responsible AI practices.
  • Experience working with cloud-based platforms, preferably AWS and Microsoft Azure.
  • Strong collaboration and communication skills, with the ability to work effectively across product, engineering, machine learning, and quality teams.
  • Experience mentoring engineers and contributing to continuous improvement in testing standards and processes.
  • Bachelor’s or Master’s degree in Computer Science, Mathematics, Physics, or a related technical field.
  • Full-time remote opportunity based in India.
  • Opportunity to work on advanced AI, software quality, cloud, and automation initiatives.
  • Exposure to large language models, agentic AI, AI security, and responsible AI practices.
  • Opportunity to influence quality engineering strategy and establish modern testing standards.
  • Collaboration with product, software engineering, machine learning, and other technical teams.
  • Opportunity to mentor team members and contribute to the development of high-performing engineering practices.
  • Experience working with cloud-native SaaS platforms across AWS and Microsoft Azure.
  • Opportunity to contribute to technology that supports complex risk assessment, resilience, and informed decision-making.
  • Inclusive environment that values curiosity, diverse perspectives, integrity, innovation, and continuous learning.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Jobgether's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Jobgether's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Jobgether's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.