Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 390 days ago

QA Automation Engineer (Founding Team)

gradientflo19 open roles

Pay
$24,000 – $32,000 a yearly
Where
Hyderābād, India
Work mode
On site
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowQA Automation Engineer (Founding Team)gradientflo · Hyderābād, India

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on gradientflo's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.1% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.1%7 days
  4. 19.1%14 days
  5. 35.6%30 days
  6. 52.7%60 days
This job: posted 390 days ago

The posting

Role Overview

You’ll be the safety net and enabler of speed at Vibecoderz. In a system where AI agents generate artifacts, mini-apps, and real-time interactions, quality isn’t just about correctness — it’s about trust.

As the founding QA Automation Engineer, you’ll design frameworks that validate not just code but also AI outputs. From traditional E2E flows to specialized agent evaluation pipelines, you’ll ensure that everything shipping to production meets our gold standard.

This role is about building autonomous, self-healing QA systems that scale with our multi-agent platform. You’ll work hand-in-hand with PM, FE, BE, AI, and DevOps to embed quality into every phase of the pipeline using Linear (execution), Notion (test cases/playbooks), and GitHub (CI/CD integration) as your tools of record.

Key Responsibilities

  1. Automation Framework Ownership Design and implement end-to-end automated test frameworks for FE, BE, and AI agents. Cover unit, integration, regression, and smoke tests.
  2. Frontend Testing Build E2E suites for Next.js UI using Playwright or Cypress. Simulate real-user flows: onboarding, AI tutor interaction, artifact generation.
  3. Backend Testing Automate FastAPI endpoint validation. Ensure <100ms response SLA is consistently met.
  4. AI Agent Evals Develop golden sets for agent responses (TutorAgent, Mini-App Generator, Quiz Generator). Automate detection of hallucinations, irrelevant answers, or unsafe outputs.
  5. Continuous Testing Integration Integrate all test suites into GitHub Actions CI/CD pipelines. Block merges unless all critical tests pass.
  6. Realtime Testing Validate WebSocket-based real-time interactions (voice transcription, live artifacts). Create stress tests for multi-user editing and presence.
  7. Security & Reliability Testing Build automated checks for prompt injection and unsafe code generation. Implement sandboxed test environments for mini-app execution.
  8. Performance & Load Testing Benchmark system under 100K concurrent learners. Identify latency bottlenecks across Pub/Sub and Cloud Run services.
  9. Defect Tracking & Reporting Use Linear for bug triage and prioritization. Create dashboards of defect density, test coverage, and agent accuracy.
  10. Culture of Quality Define QA best practices, playbooks, and documentation in Notion. Mentor engineers to write better testable code.

Success Metrics

90 Days (Probation):

  • Automated framework live for FE (Next.js) and BE (FastAPI).
  • AI TutorAgent “Text → Course” flow covered by golden set evals.
  • CI/CD pipeline enforces automated test runs before deploy.

12 Months:

  • 85% test automation coverage across platform.
  • <1% escaped defects in production.
  • AI agent eval accuracy >90% on golden set outputs.
  • System proven under 100K concurrent users with <1% error rate.

Must-Haves

  • 10+ years QA automation in SaaS/product engineering.
  • Strong expertise with Playwright/Cypress, Pytest, Postman/Newman.
  • Proven experience integrating test suites into CI/CD pipelines.
  • Familiarity with real-time systems (WebSockets, CRDT/OT).
  • Deep understanding of QA methodologies: smoke, regression, load, E2E.

Nice-to-Haves

  • Experience with LLM/AI output evaluation (evals).
  • Prior startup or founding engineer experience.
  • Knowledge of security testing (XSS, prompt injection defense).
  • Contributions to open-source QA frameworks.

Tech Stack Visibility

  • Frontend: Playwright, Cypress
  • Backend: Pytest, Postman/Newman
  • AI Evals: Custom golden set framework, LangSmith/Langfuse for prompt monitoring
  • CI/CD: GitHub Actions integration
  • Observability: OpenTelemetry hooks into test reports
  • Infra: Cloud Run staging environments for test runs

Assessment

Objective: Validate ability to design automated test frameworks that cover FE, BE, and AI outputs.

Challenge (Candidate PoC):

  1. Frontend (FE) E2E Test Write Playwright/Cypress tests for: User onboarding (sign-up with Google). Chatting with TutorAgent mock API. Rendering a Quiz block with answer validation.
  2. Backend (BE) API Test Write Pytest suite for FastAPI service: /generate-course endpoint (input: “Teach React Hooks”). Assert valid JSON structure for output.
  3. AI Agent Eval Create a golden set with 5 input prompts and expected TutorAgent responses. Automate comparison with tolerance for natural language variation.
  4. CI/CD Integration Configure GitHub Actions to run FE + BE + AI eval tests on each PR. Block merge if any critical tests fail.

Deliverables:

  • GitHub repo with FE, BE, and AI test suites.
  • GitHub Actions workflow file with integrated tests.
  • Golden set JSON for TutorAgent eval.
  • README documenting design choices and edge cases.

Evaluation Criteria:

  • Automation Framework Quality (30%)
  • AI Evals & Innovation (25%)
  • CI/CD Integration (20%)
  • Test Coverage & Reliability (15%)
  • Documentation & Clarity (10%)
From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against gradientflo's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on gradientflo's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    gradientflo's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.