Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowFirst seen 75 days ago

Associate Lead - Testing (QA + MLOps)

Quantiphi76 open roles

Where
IN KA Bengaluru
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowAssociate Lead - Testing (QA + MLOps)Quantiphi · IN KA Bengaluru

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Quantiphi's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

13.1% of postings close within 7 days. Measured by our own scanner across the market. Quantiphi postings stay open a median of 49 days.

Share of postings closed within
  1. 2.2%1 day
  2. 4.7%3 days
  3. 13.1%7 days
  4. 21.1%14 days
  5. 35.7%30 days
  6. 58.7%60 days
This job: first seen 75 days ago

Quantiphi median: 49 days open

The posting

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi! Role: Lead/Associate Lead – QA + MLOps & Generative AI Experience: 10+ years Location: Mumbai/Bangalore (Hybrid) Key Responsibilities: AI/ML & GenAI Testing Strategy (AWS Ecosystem) Define testing approaches for AI systems built on AWS services such as: Amazon SageMaker Amazon Bedrock AWS Lambda Amazon API Gateway Amazon Kinesis AWS Glue Amazon S3 Amazon CloudWatch Design validation frameworks covering: Model accuracy & performance validation Data drift & concept drift detection Hallucination detection for LLMs Prompt robustness testing RAG validation (retrieval accuracy + grounding) Bias & fairness validation Safety & toxicity testing MLOps Quality Engineering (AWS-Centric) Validate the end-to-end ML lifecycle including: Data ingestion & feature pipelines Model training & hyperparameter tuning Model versioning & registry Deployment validation Canary & blue/green release validation Work with AWS-native services such as: SageMaker Pipelines SageMaker Model Monitor SageMaker Feature Store Bedrock model evaluation workflows CloudWatch-based observability Implement CI/CD quality gates for ML pipelines integrated with AWS DevOps tools. GenAI & Agentic AI Testing Define quality engineering approaches for: LLM-based applications using Amazon Bedrock Prompt engineering validation Multi-agent orchestration testing Chatbot & Voice bot conversational testing Intent classification validation Conversation drift & fallback validation API contract validation for LLM integrations Build reusable evaluation harnesses for: BLEU / ROUGE scoring Embedding similarity scoring Response consistency Safety scoring frameworks Framework & Capability Development Design reusable AI testing accelerators Create AWS-aligned AI test automation frameworks (Python-first) Develop synthetic data generation strategies Establish AI quality scorecards Build an internal AI QA Center of Excellence Client Engagement & Leadership Lead AI/ML quality strategy workshops Perform AI risk & readiness assessments Present quality architecture to CXOs Drive QA transformation programs Mentor QA teams on AWS-based AI testing Own delivery for AI testing engagements end-to-end Must have skills: Testing Expertise 8–12+ years in Quality Engineering Strong test strategy, automation & governance experience Experience leading QA transformation initiatives Experience building frameworks from scratch AI/ML & GenAI Expertise Deep understanding of ML lifecycle Experience testing ML models (NLP preferred) Hands-on experience validating LLM applications Strong understanding of: Prompt engineering RAG architecture Embeddings Bias & explainability AWS AI/ML Expertise Hands-on experience with: Amazon SageMaker (training, deployment, monitoring) Amazon Bedrock (LLM integration & evaluation) S3-based data pipelines AWS IAM (security validation) CloudWatch monitoring Lambda & API Gateway integrations AWS CI/CD (CodePipeline / CodeBuild preferred) Understanding of: Infrastructure as Code (Terraform / CloudFormation) Observability in AI systems Cost monitoring for ML workloads Technical Skills Python (mandatory) Experience with ML libraries (Scikit-learn, TensorFlow, PyTorch) Experience with LLM frameworks (LangChain, etc.) API & automation testing frameworks Git-based workflows Leadership & Communication Strong client-facing communication Experience leading QA teams Ability to create strategy decks & solution proposals Strong stakeholder management If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us! Thank you for your interest in Quantiphi! We are a team that dreams together and collaborates to ensure success. We are currently looking for exceptional individuals who can join us and contribute to a fun, diverse and hybrid work culture. As a part of the Quantiphi family, you will get ample opportunities to learn, grow and interact with colleagues from varied experience and backgrounds around the globe. If this excites you, explore our current openings and apply to any job roles that suit and interest you. Quantiphi is an award-winning AI-first digital engineering company driven by the desire to reimagine and realize transformational opportunities at the heart of business. We solve the toughest and most complex business problems with the latest and cutting-edge technologies and to make this happen, we have a vibrant, diverse and talented set of professionals we proudly refer to as the Quantiphi family. Our culture is built on transparency, diversity, integrity, learning and growth. We are committed to provide our teams with an environment that helps them to learn, grow and flourish in their professional as well as personal lives.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Quantiphi's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Quantiphi's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Quantiphi's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.