Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 14 hours ago

Testing Engineer

Robots and Pencils37 open roles

Where
Colombia
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowTesting EngineerRobots and Pencils · Colombia

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Robots and Pencils's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.1% of postings close within 7 days. Measured by our own scanner across the market. Robots and Pencils postings stay open a median of 10 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.1%7 days
  4. 19.1%14 days
  5. 35.6%30 days
  6. 52.7%60 days
This job: posted 14 hours ago

Robots and Pencils median: 10 days open

The posting

Testing Engineer

Location: Colombia

Company Overview

Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for our clients. We're all in on AWS, combining deep UX capability with senior engineering talent to get AI into production fast and keep it there. We’ve earned the trust of leaders across Consumer Products and Retail, Education, Energy, Financial Services, Healthcare, and Manufacturing and more, and earned a reputation as the nimble alternative to traditional global systems integrators. Founded in 2009, with delivery centers in Canada, the United States, Eastern Europe, and Latin America, we are smaller, faster, and more senior by design. Our teams average 15+ years of experience. We move fast, sweat the details, and build things that actually ship.

Position Overview

We’re looking for a Testing Engineer to build and maintain quality across software features and AI/ML systems. This role is ideal for an engineer who can confidently own testing responsibilities across automation and AI, contributes to quality strategy discussions, and is ready to take on real responsibility from day one.

In this role, you will work as a contributing member of a cross-functional team, writing automated tests, validating AI/ML pipelines and outputs, and integrating quality practices into the delivery process. You’ll be joining real, in-flight work where quality and delivery speed matter, collaborating with experienced engineers and growing the technical instincts that come from shipping things that matter.

Why This Role Matters

At Robots & Pencils, we design AI systems for a human world. Our name says it all. Robots and pencils means engineering paired with creativity, because every agent we ship has to work for real people in real workflows. That balance is baked into how we operate.

Every role here contributes directly to that mission. Here, you shape how AI systems integrate into enterprise operations, how teams move at real velocity, and how products create measurable impact for clients and the people they serve. We ship production-ready AI in 30 to 45 days. That pace demands people who take ownership, lead with craft, and care deeply about what they put their name on.

What You’ll Do

Craft & Delivery

  • Write and maintain automated test scripts for UI, API, and integration testing (e.g., Selenium, Cypress, Playwright, PyTest)
  • Validate ML model outputs including accuracy, consistency, and expected behavior against defined criteria
  • Test data pipelines and AI workflows, performing dataset validation and data quality checks
  • Execute automated test suites, analyze results, and identify, document, and track defects (e.g., Jira, TestRail)
  • Integrate automated tests into CI/CD pipelines to support continuous quality (e.g., GitHub Actions, GitLab CI, Jenkins)
  • Support model evaluation processes and assist in testing AI workflows end-to-end
  • Test AI/ML systems, including LLM evaluation (accuracy, hallucination, toxicity, bias), RAG retrieval quality and grounding, model drift monitoring, prompt regression testing, and AI safety and red-teaming
  • Bring an AI-forward mindset to your daily work, using tools like Claude, Cursor, and other modern AI assistants to ship higher-quality work at pace

Collaboration & Communication

  • Collaborate closely with developers, ML engineers, and data scientists to align quality efforts with delivery goals
  • Participate in sprint ceremonies and contribute to quality strategy discussions
  • Provide clear testing reports and communicate quality status to the team

Leadership & Influence

  • Take ownership of testing responsibilities end-to-end and follow through with consistency
  • Contribute to QA process improvements and identify opportunities for greater test coverage or automation
  • Bring intellectual curiosity to every problem — ask good questions, explore edge cases, and stay hungry to grow your craft

What You’ll Bring

  • 2+ years of experience in test automation or AI/ML testing, with comfort in at least one track and working knowledge of the other
  • Proficiency in Python, JavaScript, Java, or similar, with the ability to write and maintain test code independently
  • Experience with test automation frameworks for UI, API, or ML workflows
  • Understanding of AI/ML concepts and the ML lifecycle, with the ability to validate model outputs against defined criteria
  • Experience with CI/CD pipelines and version control
  • Working knowledge of API testing and data validation
  • Solid understanding of SDLC/STLC and Agile methodologies
  • Proficiency with bug-tracking and test management tools
  • Familiarity with testing AI/ML systems, including LLM evaluation (accuracy, hallucination, toxicity, bias), RAG retrieval quality and grounding, model drift monitoring, prompt regression testing, and AI safety and red-teaming
  • Demonstrable, day-to-day usage of AI-forward tools such as Claude and Cursor
  • Strong problem-solving skills and the ability to work through ambiguous testing challenges with sound judgment
  • Experience with mobile automation, performance testing, MLOps pipelines, or basic statistics is a plus

You’ll Do Well Here if You Are

  • A doer. You see something broken and fix it. You'd rather move on clarity than wait for certainty.
  • A fast learner who knows you don't know everything. The AI landscape changes weekly. You're senior enough to know better and curious enough to keep learning anyway.
  • Direct in a way that makes the work better. You give honest feedback. You'd rather have the hard conversation than blow smoke.
  • Obsessed with craft. You know genius is in the details. You ship exceptional, not perfect, and you don't put your name on work you wouldn't stand behind.
  • Built for ownership. You honor commitments, admit mistakes fast, and back your teammates when a decision costs something. No handoffs, no finger-pointing.
  • All in. You treat clients' businesses like your own. You take the work seriously without taking yourself seriously.
  • Resourceful when the budget, timeline, or team is tight. Constraints don't slow you down. They sharpen you.
  • Glad to be in the room with people who care as much as you do. Our teams average fifteen-plus years of experience. We hire people who push each other to do better work.
From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Robots and Pencils's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Robots and Pencils's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Robots and Pencils's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.