Skip to content

Open nowPosted 308 days ago

QA automation engineer

Exterview6 open roles

Where
Hyderābād, India
Work mode
On site
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowQA automation engineerExterview · Hyderābād, India
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Exterview's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

11.4% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.0%1 day
  2. 4.2%3 days
  3. 11.4%7 days
  4. 17.5%14 days
  5. 34.2%30 days
  6. 43.5%60 days
This job: posted 308 days ago

The posting

Role Overview

You will be the Quality Intelligence Architect of Exterview.

As a QA Automation Engineer (10+ Years), you’ll design, implement, and own the automation and quality orchestration system that validates AI-driven candidate screening, live interviews, scoring agents, and feedback pipelines.

This is quality engineering at scale: validating probabilistic AI outputs, real-time interview flows, event-driven systems, and media-heavy workflows across thousands of concurrent interviews.

You’ll work closely with Backend, AI Engineering, Prompt Engineering, and Frontend teams to ensure quality is built into the system, not tested after the fact.

Execution is tracked via Linear (tasks), Notion (PRDs & test strategy), and GitHub (automation reviews) ensuring quality decisions are transparent and measurable.

Key Responsibilities

Automation Architecture

  • Design and own a scalable, maintainable automation framework for: Web (Next.js) APIs (GraphQL via AppSync, REST) Event-driven and async workflows
  • Move QA from test execution to quality architecture ownership.

AI & Probabilistic System Validation

  • Validate: Resume parsing accuracy AI scoring consistency Interview logic stability
  • Define assertion strategies for non-deterministic AI outputs.

Real-Time & Media Workflow Testing

  • Test live interview systems: VideoSDK + Tavus video flows Real-time state updates
  • Validate video upload, playback, retries, and failure handling.

API, Event & Integration Testing

  • Build API-first automation for: GraphQL queries & mutations Lambda & microservice APIs
  • Validate event-driven flows (notifications, interview state transitions).

Performance, Load & Reliability Testing

  • Design load and stress tests for: Interview orchestration APIs Video playback & report generation
  • Ensure system reliability under peak concurrency.

CI/CD & Quality Gates

  • Integrate automation into GitHub Actions.
  • Define release quality gates and production sign-off criteria.
  • Track flaky tests, failure patterns, and quality metrics.

Cross-Team Quality Leadership

  • Translate product requirements into test strategies.
  • Partner with engineering to improve testability & observability.
  • Mentor junior and mid-level QA engineers.

Success Metrics

First 90 Days

  • Stable automation framework covering UI + API + AI workflows.
  • Flaky test rate reduced to near zero.
  • API-level load tests live for interview & video flows.
  • Release quality gates enforced in CI/CD.

12 Months

  • End-to-end automation coverage for all interview types.
  • Predictable, fast release cycles with no QA bottlenecks.
  • AI validation framework adopted as product standard.
  • QA recognized as product quality owner, not gatekeeper.

Must-Haves

  • 10+ years in QA Automation / SDET roles
  • Strong experience designing automation frameworks, not just writing scripts
  • Expertise in API testing (GraphQL & REST)
  • Experience testing real-time and async systems
  • Ability to validate AI-driven, non-deterministic outputs
  • Strong understanding of CI/CD, release quality, and production readiness

Nice-to-Haves

  • Experience testing AI/ML or agent-based systems
  • Media or video workflow testing experience
  • Startup or high-scale SaaS background
  • Prior ownership of QA strategy for a product

Tech Stack Visibility

  • Frontend: Next.js, TypeScript
  • Automation: Cypress, Playwright, Jest
  • Backend: Node.js, AWS Lambda, Serverless Framework
  • APIs: GraphQL (AWS AppSync), REST
  • Auth: AWS Cognito (OAuth, OTP)
  • Data: MongoDB Atlas
  • Media: VideoSDK, Tavus, Amazon S3
  • Communication: Twilio (SMS, WhatsApp, IVR)
  • Observability: Langfuse, internal monitoring

Assessment (PoC)

Objective

Validate your ability to design quality systems, not just write test cases.

Challenge Overview

Design and implement an automation strategy for an AI-driven interview flow.

The system should validate:

  • Resume upload & parsing
  • AI resume–job match scoring
  • Interview scheduling
  • Live interview execution
  • Interview report generation

Functional Expectations

1. Automation Design

  • Cover: One UI flow One GraphQL API flow One real-time or async workflow
  • Show clear separation between test layers.

2. AI Validation Strategy

  • Define how you: Assert AI scores Detect drift or instability Handle acceptable variance

3. Performance & Reliability

  • Include: One API load test Failure / retry validation
  • Avoid direct S3 URL testing; use APIs only.

Deliverables

  • Automation repo (clean structure)
  • Test strategy README
  • Example AI assertion logic
  • CI pipeline config (GitHub Actions)
  • ≤ 5 min Loom walkthrough explaining decisions
From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Exterview's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Exterview's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Exterview's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.