Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 20 days ago

AI Platform Senior Engineer, QA

Accrete9 open roles

Pay
₹10 an hour
Where
Mumbai, India
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowAI Platform Senior Engineer, QAAccrete · Mumbai, India

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Accrete's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.4% of postings close within 7 days. Measured by our own scanner across the market. Accrete postings stay open a median of 10 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.4%7 days
  4. 20.0%14 days
  5. 35.5%30 days
  6. 58.6%60 days
This job: posted 20 days ago

Accrete median: 10 days open

The posting

About Accrete

Accrete is an agentic managed services company: an AI workforce that does high-stakes, judgement-heavy work for government and enterprise clients — at the economics of software, not labor.

At the core is Accrete’s Knowledge Engine, a dynamic context graph that captures an organization’s tacit knowledge, resolves data across silos, and builds a living, auditable ground truth. Expert agents reason against that ground truth to act on complex, high-stakes decisions — not just answer questions about them.

From national security to commercial operations, Accrete delivers the work on one platform, with unlimited expert agents and expert judgement.

About the Role:

We are seeking an AI Platform Senior Engineer, QA – Agentic AI & Automation to lead quality assurance for our agent-driven platforms and AI models. This role focuses on validating intelligent agents, non-deterministic AI outputs, and cross-product workflows using advanced automation and AI evaluation techniques.

You will play a key role in building our Enterprise AI Trust & Validation Framework, ensuring reliability, transparency, and scalability of AI systems.

Key Responsibilities

Agentic AI & System Testing

  • Test multi-agent workflows, orchestration layers, and cross-domain intelligence systems
  • Validate AI-generated narratives, themes, and analytical outputs.
  • Perform groundedness, coherence, hallucination, and stability testing.
  • Test conversational AI and chat-based agent systems.
  • Evaluate consistency across multiple runs and detect output drift.

Automation & Framework Development

  • Design and maintain automation frameworks using Python, JavaScript/TypeScript, Pytest, and Playwright.
  • Build E2E automation for UI, APIs, and agent pipelines.
  • Develop reusable test utilities for AI validation and regression testing.
  • Integrate automation with CI/CD pipelines.

AI Model & Evaluation Testing

  • Validate in-house AI/ML models and inference pipelines.
  • Implement LLM-as-Judge and semantic similarity-based validation.
  • Perform statistical and comparative testing for model outputs.
  • Support testing of models deployed on AWS.

API & Performance Engineering

  • Perform API testing using Postman and automated scripts.
  • Design and execute load and stress testing.
  • Monitor system performance under AI-heavy workloads.
  • Identify bottlenecks and scalability risks.

Quality Strategy & Collaboration

  • Analyze business requirements, user stories, and AI specifications.
  • Design test strategies for agentic and AI-driven systems.
  • Work closely with Engineering, Product, and Data Science teams.
  • Track defects, quality metrics, and release readiness.
  • Drive continuous improvement in QA processes

Required Qualifications

  • 6–8+ years of experience in QA, Automation, or Quality Engineering.
  • Strong proficiency in Python, JavaScript/TypeScript, Pytest, and Playwright.
  • Experience testing AI systems, chatbots, or LLM-based platforms.
  • Strong understanding of non-deterministic system testing.
  • Experience with API testing (Postman, REST frameworks).
  • Hands-on experience with performance testing. (K6 familiarity is a plus).
  • Experience working in Agile/Scrum environments.
  • Strong analytical and debugging skills.
  • Excellent communication and documentation abilities.

Preferred Qualifications

  • Experience with agent frameworks (LangChain, AutoGen, CrewAI, etc.).
  • Knowledge of RAG systems and vector databases.
  • Exposure to MLOps and AI observability tools.
  • Experience with cloud platforms (AWS preferred).
  • Familiarity with statistical validation and NLP evaluation.
  • CI/CD experience (GitHub Actions, Jenkins, GitLab).
  • Familiarity with containerization technologies such as Docker/Kubernetes

Core Competencies

  • AI Quality Engineering
  • Agent Workflow Validation
  • Automation Architecture
  • Model Evaluation & Monitoring
  • Performance Engineering
  • Risk Assessment
  • Cross-team Collaboration
  • Ownership Mindset

Career Growth

This role offers growth into positions such as:

  • Principal AI QA Engineer
  • AI Systems Quality Architect
  • QA Engineering Lead
  • AI QA Engineering Manager

Cultural Fit & Values

At Accrete, success goes beyond technical expertise. We value:

  • Ownership & Accountability: Drive initiatives to completion with high standards and proactive problem-solving.
  • Transparency & Communication: Share information openly and give and receive constructive feedback.
  • Strategic Thinking & Problem-Solving: Analyze challenges critically and develop effective, scalable solutions.
  • Collaboration & Professionalism: Work effectively across teams and contribute to a culture of mutual respect.
  • Passion for AI & Innovation: Stay curious, continuously learn, and push the boundaries of AI.
  • Going Beyond the Job Description: Look for opportunities to create impact beyond your immediate responsibilities. These principles shape our culture, performance expectations, and growth opportunities.

Company Benefits

  • Competitive Compensation: Aligned with experience and market standards.
  • Mediclaim: ₹10 lakh coverage for you and your family.
  • Flexible PTO & Hybrid Work: Take time off when needed and enjoy remote flexibility in accordance with company guidelines.
  • Growth & Development: Access to professional learning opportunities and career advancement support.
  • Onsite Perks: Catered lunches and snacks.
  • Team Bonding: Company-sponsored social events and team activities.

Accrete is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Accrete's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Accrete's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Accrete's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.