Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 34 days ago

AI Operations Specialist - LLM & Conversation Systems

Workable (global search)108,016 open roles

Where
Argentina
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowAI Operations Specialist - LLM & Conversation SystemsWorkable (global search) · Argentina

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Workable (global search)'s own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

7.9% of postings close within 7 days. Measured by our own scanner across the market. Workable (global search) postings stay open a median of 7 days.

Share of postings closed within
  1. 1.6%1 day
  2. 3.6%3 days
  3. 7.9%7 days
  4. 14.9%14 days
  5. 34.0%30 days
This job: posted 34 days ago

Workable (global search) median: 7 days open

The posting

AI Operations Specialist – LLM & Conversation Systems

Position Type: Full-Time, Remote Working Hours: U.S. Business Hours

About the Role

We are looking for a hands-on AI Operations Specialist to own and improve our production AI conversation systems.

We are an AI-powered SMS lead recovery platform serving telehealth brands, processing millions of messages each month. Our AI systems interact directly with customers, and their performance directly impacts client conversions.

In this role, you'll onboard new clients, configure AI conversation systems, monitor live conversations, diagnose issues, improve prompts and system behavior, and measure whether your changes actually improve conversion.

This is not a theoretical AI role. We're looking for someone who has run LLM systems in production and understands how to continuously monitor, troubleshoot, test, and improve them.

Responsibilities

Client Onboarding & AI Setup

  • Onboard new clients into the AI conversation platform.
  • Set up webhook integrations and client knowledge bases.
  • Configure campaigns and conversation workflows.
  • Ensure new client systems are properly tested before going live.
  • Troubleshoot integration and configuration issues during onboarding.

Production AI Operations

  • Monitor live AI-generated conversations and customer interactions.
  • Review conversations to identify errors, inconsistencies, and missed opportunities.
  • Diagnose AI failure modes and determine their root causes.
  • Identify issues affecting conversation quality and conversion.
  • Escalate technical issues when necessary and follow through until resolved.

Prompt & System Optimization

  • Write, edit, and improve prompts that generate customer-facing messages.
  • Adjust system instructions and conversation logic based on real-world performance.
  • Test changes systematically before and after deployment.
  • Maintain documentation of prompt and system changes.
  • Continuously improve AI behavior while maintaining accuracy and consistency.

Performance & Conversion Analysis

  • Analyze conversation transcripts and performance data.
  • Measure whether system and prompt changes improve conversion.
  • Identify patterns across conversations that can inform future improvements.
  • Track key performance outcomes and communicate findings to leadership.
  • Use data and real customer interactions to guide optimization decisions.

Founder Collaboration

  • Work directly with the founder on daily AI operations and improvements.
  • Communicate issues, findings, and recommendations clearly.
  • Take ownership of problems from identification through resolution.
  • Move quickly while maintaining high standards for customer-facing AI output.

Required Experience & Skills

Must-Have

  • Proven experience running LLM or AI systems in production.
  • Hands-on experience monitoring and improving production AI outputs.
  • Experience with prompt engineering and system prompt optimization.
  • Strong understanding of LLM behavior, failure modes, and iterative testing.
  • Experience analyzing AI-generated conversations or customer-facing outputs.
  • Ability to work with webhooks, APIs, knowledge bases, or similar integrations.
  • Strong analytical and problem-solving skills.
  • Excellent written English — required for editing customer-facing AI messages and documenting system changes.
  • Strong attention to detail.
  • Ability to work independently and take ownership of production systems.

What Makes You a Strong Fit

  • You've actually operated AI systems in production rather than only experimenting with ChatGPT.
  • You are comfortable reviewing hundreds or thousands of AI interactions to identify patterns and problems.
  • You think in terms of outcomes and conversion, not just whether the AI response sounds good.
  • You are methodical about testing changes and measuring their impact.
  • You can quickly identify why an AI system is behaving incorrectly and determine how to improve it.
  • You communicate clearly and document your work thoroughly.
  • You enjoy working directly with a founder in a fast-moving environment.

What Does a Typical Day Look Like?

You'll begin by reviewing the performance of live AI conversations and looking for unusual patterns, failures, or opportunities for improvement.

You may spend part of the day onboarding a new telehealth client, configuring their knowledge base and integrations, and setting up their campaigns.

You'll also review conversation transcripts, identify issues with AI responses, update prompts or system instructions, test your changes, and monitor the resulting conversion performance.

Throughout the day, you'll work directly with the founder to discuss findings, prioritize improvements, and make sure production systems continue performing effectively.

Interview Process

  1. Initial Recruiter Screening
  2. Client Interview
  3. Offer Stage

#LI-AG1

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Workable (global search)'s own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Workable (global search)'s form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Workable (global search)'s answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.