Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 135 days ago

Lead Software Engineer in Test – Agentic AI (Remote - US)

Nextech Systems5 open roles

Where
Remote
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowLead Software Engineer in Test – Agentic AI (Remote - US)Nextech Systems · Remote

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Nextech Systems's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

13.6% of postings close within 7 days. Measured by our own scanner across the market. Nextech Systems postings stay open a median of 36 days.

Share of postings closed within
  1. 2.3%1 day
  2. 4.7%3 days
  3. 13.6%7 days
  4. 21.9%14 days
  5. 36.9%30 days
  6. 59.0%60 days
This job: posted 135 days ago

Nextech Systems median: 36 days open

The posting

Why join Nextech?

We are a leader in specialty healthcare technology solutions.

We’re committed to hiring and retaining talent, which is why we invest in our employees through competitive pay, a generous bonus structure, great healthcare, a comprehensive wellness program, and many other benefits.

If you are a software engineer, finance or accounting professional, customer support specialist, or a business development expert with a passion for healthcare technology (just to name a few), we want to hear from you.

We are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics are encouraged to apply. If you are a candidate in need of assistance or an accommodation in the application process, please contact [email protected].

Essential Functions

  • In addition to adhering to Nextech’s conduct and behavioral standards, responsibilities include:
  • Design, develop, and maintain scalable automation frameworks and regression test suites across UI, API, backend, and AI-driven applications.
  • Lead quality engineering initiatives for Agentic AI systems, including LLM workflows, RAG pipelines, autonomous agents, and distributed orchestration platforms.
  • Validate complex AI agent behaviors such as multi-agent coordination, tool calling, prompt chaining, memory retention, conversational workflows, and fallback/retry mechanisms.
  • Develop and execute functional, integration, regression, end-to-end, and performance testing strategies across cloud-native and distributed environments.
  • Collaborate with Software Engineers, Product Managers, and DevOps teams to integrate testing throughout the software development lifecycle.
  • Build reusable automation solutions to validate APIs, orchestration layers, asynchronous workflows, enterprise integrations, and AI-driven business processes.
  • Design and maintain robust test environments, CI/CD integrations, cloud execution platforms, and automation pipelines to improve efficiency and reliability.
  • Establish and drive best practices related to code quality, maintainability, scalability, dependency injection, observability, and testability.
  • Lead validation efforts for AI workflow resiliency, distributed system reliability, data consistency, and orchestration performance under failure and edge-case conditions.
  • Mentor QA engineers and contribute to the development of scalable QA standards, automation strategies, reporting practices, and continuous improvement initiatives.

Minimum Requirements

  • Bachelor’s degree in Computer Science, MIS, Engineering, or a related technical field.
  • 8+ years of experience in Software Development or Software Engineer in Test (SDET/SET) roles.5+ years of hands-on experience developing automation frameworks using JavaScript/TypeScript or Java.
  • Strong experience with automation tools such as Playwright, Cypress, Postman, K6, or equivalent frameworks.2+ years of experience testing AI-powered applications, LLM systems, Agentic AI platforms, orchestration frameworks, or autonomous workflows.
  • Hands-on experience validating agent orchestration workflows, conversational AI applications, multi-step reasoning systems, and AI-driven business processes.
  • Experience testing AI orchestration frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar technologies.
  • Strong expertise in API testing, backend integration testing, UI automation, and end-to-end workflow validation.
  • Solid understanding of automation architecture, design patterns, anti-patterns, dependency injection, and inversion of control principles.
  • Experience working in cloud-native and containerized environments (Azure, AWS, GCP, Docker, Kubernetes).Proven experience integrating automated test suites into CI/CD pipelines and distributed cloud environments.
  • Experience validating asynchronous, event-driven, and distributed systems with a focus on resiliency and fault tolerance.
  • Strong analytical, debugging, troubleshooting, and problem-solving skills.
  • Excellent organizational, communication, and stakeholder collaboration skills in Agile environments.
  • Experience with AI observability, telemetry, RAG pipeline validation, vector databases, or prompt evaluation frameworks (preferred).

Preferred Qualifications

  • Experience with Azure DevOps, GitHub Actions, or similar CI/CD platforms.
  • Experience with AI observability tools, telemetry platforms, and prompt evaluation frameworks.Experience validating RAG pipelines, vector databases, and AI response accuracy.
  • Knowledge of healthcare systems, HIPAA compliance, and regulated enterprise environments.
  • Experience with event-driven architectures, messaging systems, and distributed data platforms (including SQL Server).
  • Prior experience leading QA teams, mentoring engineers, and implementing enterprise test reporting and quality metrics practices.

Work Environment/Physical Demands

  • Remote work
  • Activities require a significant amount of work in front of a computer monitor.

Total Rewards: Generous annual bonus opportunity

401(k) with Employer Match

Flexible Time Off: take time off when you need it without worrying about available hours

11 paid holidays

Your Day Your Way - Celebrate a day of cultural or social significance to you

Access to Linkedin Learning courses for professional development

Insurance: Choice of Medical, Dental, and Vision plans

Health Savings Account with employer match

Flexible Spending Account

100% Company-Paid Parental leave (After 6 months with the company)

Company-Paid Life Insurance and Short/Long Term Disability Insurance

Nextech Luminary Peer Recognition Program

Employee Assistance Program with free counseling sessions available

Corporate Discounts on Retail, Travel, and Entertainment

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Nextech Systems's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Nextech Systems's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Nextech Systems's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.