Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 3 days ago

Hiring: AI Engineer / Generative AI Engineer | (Agentic AI,AWS Bedrock AgentCore,Claude Agent SDK,Langfuse) | Los Angeles, CA (Hybrid)

TMS LLC7 open roles

Where
Los Angeles, CA, United States
Work mode
Hybrid
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowHiring: AI Engineer / Generative AI Engineer | (Agentic AI,AWS Bedrock AgentCore,Claude Agent SDK,Langfuse) | Los Angeles, CA (Hybrid)TMS LLC · Los Angeles, CA, United States

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on TMS LLC's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

13.4% of postings close within 7 days. Measured by our own scanner across the market. TMS LLC postings stay open a median of 7 days.

Share of postings closed within
  1. 2.2%1 day
  2. 4.6%3 days
  3. 13.4%7 days
  4. 21.6%14 days
  5. 36.2%30 days
  6. 59.0%60 days
This job: posted 3 days ago

TMS LLC median: 7 days open

The posting

Job Description

Role: AI Engineer / Generative AI Engineer

Duration: 3+ Months (Extension Possible)

Location: Los Angeles, CA (Hybrid)

Specialisation: Agentic AI, AWS Bedrock AgentCore, Claude Agent SDK, Langfuse, AI Observability & Evaluation

Job Summary

We are seeking an experienced AI Engineer with strong hands-on expertise in building, deploying, and monitoring production-grade AI agents and Generative AI solutions using AWS technologies.

The ideal candidate will have experience developing AI agents using Claude Agent SDK, deploying them on Amazon Bedrock AgentCore Runtime, automating deployments through GitHub Actions, and implementing Langfuse for observability and continuous evaluation of agent traffic.

The role requires a strong combination of AI engineering, cloud deployment, data pipeline development, and LLM performance monitoring.

Key Responsibilities

1. Agentic AI Development

  • Design, develop, and deploy AI agents using Claude Agent SDK and Python.
  • Build intelligent, autonomous agents capable of executing complex workflows and interacting with external tools, APIs, and knowledge bases.
  • Develop agent orchestration workflows with appropriate error handling, retry mechanisms, and guardrails.
  • Integrate AI agents with enterprise applications and data sources.

2. AWS Bedrock & AgentCore

  • Deploy and manage AI agents using Amazon Bedrock AgentCore Runtime.
  • Develop scalable, secure, and production-ready agent architectures on AWS.
  • Integrate agents with Amazon Bedrock foundation models and enterprise knowledge bases.
  • Implement agent authentication, access controls, logging, and runtime monitoring.

3. Langfuse Deployment & AI Observability

  • Deploy, configure, and maintain Langfuse for comprehensive LLM and agent observability.
  • Integrate Langfuse with AI agents to capture traces, prompts, responses, tool calls, and execution metrics.
  • Monitor agent performance, response latency, token consumption, and operational costs.
  • Identify and troubleshoot production issues through distributed tracing and monitoring dashboards.

4. Continuous Agent Evaluation

  • Design and implement continuous evaluation frameworks for production AI agent traffic.
  • Evaluate agent responses for accuracy, relevance, hallucinations, task completion, and tool execution quality.
  • Develop automated evaluation pipelines using Langfuse, LLM-as-a-Judge, and custom evaluation metrics.
  • Implement continuous feedback mechanisms to improve agent reliability and effectiveness.
  • Establish quality benchmarks and detect agent performance regressions.

5. Data Pipelines & Knowledge Base Integration

  • Develop AWS Step Functions workflows integrating Amazon Textract and Amazon Comprehend for intelligent document processing.
  • Build document ingestion, preprocessing, and data transformation pipelines.
  • Implement vector database solutions, including document chunking, embedding generation, and vector indexing.
  • Integrate AI agents with Retrieval-Augmented Generation (RAG) pipelines and enterprise knowledge bases.
  • Optimize retrieval performance and contextual accuracy.

6. CI/CD & Deployment Automation

  • Build and maintain CI/CD pipelines using GitHub Actions.
  • Automate agent code builds, testing, deployment, and configuration management.
  • Implement deployment workflows for Amazon Bedrock AgentCore Runtime.
  • Integrate automated agent evaluations into CI/CD processes.
  • Apply DevOps best practices for version control, release management, and production monitoring.

Required Technical Skills

  • Programming: Strong Python development experience.
  • Agentic AI: Claude Agent SDK, AI agent development, agent orchestration, tool calling.
  • AWS AI Services: Amazon Bedrock, Bedrock AgentCore Runtime, Step Functions, Textract, Comprehend.
  • Observability: Langfuse deployment, LLM tracing, monitoring, performance analysis.
  • Evaluation: Continuous agent evaluation, LLM-as-a-Judge, evaluation metrics and automated testing.
  • DevOps: GitHub Actions, CI/CD pipelines, Git, deployment automation.
  • RAG: Vector databases, embeddings, chunking strategies, indexing, knowledge base integrations.
  • Cloud: AWS architecture, IAM, CloudWatch, security, and deployment practices.

Good-to-Have Skills

  • Experience with LangChain, LangGraph, or other agent orchestration frameworks.
  • Experience with RAGAS, DeepEval, or similar LLM evaluation frameworks.
  • Familiarity with Amazon OpenSearch, Pinecone, FAISS, or pgvector.
  • Experience with Docker, Terraform, or infrastructure as code.
  • Knowledge of Model Context Protocol (MCP).
  • Experience with prompt engineering, guardrails, and AI governance.
  • Experience deploying enterprise Generative AI solutions in production environments.

Qualifications

  • 6–8+ years of software engineering, cloud engineering, or AI/ML development experience.
  • Strong hands-on experience building Generative AI or Agentic AI applications.
  • Demonstrated experience deploying and supporting AI agents in production.
  • Strong understanding of AWS cloud services, LLM architectures, and automated deployment processes.
  • Ability to independently design, implement, troubleshoot, and optimize AI agent solutions.

Ideal Candidate Profile

A hands-on AI Engineer who can take an agent from development through production deployment and ongoing evaluation. The candidate should be proficient in Claude Agent SDK, AWS Bedrock AgentCore, Langfuse, GitHub Actions, and continuous AI agent evaluation, with the ability to build reliable, scalable, and observable enterprise AI solutions.

Additional Information

All your information will be kept confidential according to EEO guidelines.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against TMS LLC's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on TMS LLC's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    TMS LLC's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.