Skip to content

Open nowPosted yesterday

Software Engineer, AI Agents

epiqsystems90 open roles

Pay
$180,000 – $260,000 a year
Where
New York, NY
Work mode
Hybrid
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSoftware Engineer, AI Agentsepiqsystems · New York, NY
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on epiqsystems's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

13.7% of postings close within 7 days. Measured by our own scanner across the market. epiqsystems postings stay open a median of 13 days.

Share of postings closed within
  1. 2.3%1 day
  2. 4.8%3 days
  3. 13.7%7 days
  4. 22.1%14 days
  5. 37.6%30 days
  6. 59.1%60 days
This job: posted yesterday

epiqsystems median: 13 days open

The posting

At Epiq, your work contributes to complex, global legal outcomes. You’ll join a values‑driven community where integrity guides decisions, relentless service sets the bar, and we thrive on big challenges together. We invest in your growth with enterprise‑wide learning and mobility. We celebrate who you are, and we respect life beyond work with flexibility that’s recognized externally. Enabled by modern platforms and AI, you’ll do the most meaningful work of your career and see your impact at scale.

Job Description:

Epiq AI Labs is the innovation and engineering hub behind Epiq’s next-generation AI platform for corporate legal departments and global law firms. Operating with the speed and autonomy of a startup and the resources of a global alternative legal services provider, the team builds intelligent agents, reasoning engines, knowledge systems, and structured workflows for litigation, investigations, compliance, and corporate knowledge work.

We are fast, experimental, and product-obsessed, with high autonomy, high trust, and low bureaucracy. We ship to real legal clients and hold a high bar for correctness, and we use AI tools throughout our own development workflow. The team is deeply technical, highly collaborative, and owns its systems end to end — you design it, you build it, you ship it.

The Opportunity

You will build the agentic systems at the center of Epiq AI Labs’ legal AI platform, including the orchestration runtime used by other teams, the retrieval layer agents reason over, and the evaluation infrastructure used to measure quality. You will own systems from initial design through production operation.

Legal workflows require a high standard of correctness, traceability, confidentiality, and tenant isolation. You will establish the primitives for orchestration, grounded retrieval, and measurable quality that other engineering teams will build on.

Essential Job Responsibilities

  • Design the agentic platform: orchestration of single agents and parallel sub-agents, durable state and memory across long-running jobs, MCP-based tool integration, and trace-level observability.
  • Build the safety layer agents run inside: tool registration and permissioning, sandboxing, guardrails and output validation, and defenses against prompt injection from retrieved content.
  • Build agent workflows with multi-step reasoning, tool use, human-in-the-loop checkpoints, and recovery from partial failure during long-running execution.
  • Evaluate developments in model capabilities, agent-design patterns, and evaluation practices, and translate them into platform architecture.
  • Design retrieval-augmented generation systems with hybrid search over legal corpora and citation grounding to specific sources.
  • Own and evolve the in-house model services behind classification, extraction, and embeddings — including customer-trained custom models with active learning — and integrate them alongside frontier models.
  • Build model-level and end-to-end evaluation datasets, benchmarks, and regression checks for classification, extraction, retrieval, and agent workflows. Work with legal domain experts to turn real workflows, corrections, and failure cases into quality improvements, with automated evaluation in CI and monitoring of quality, latency, and cost in production.
  • Establish LLMOps practices for running models reliably in production: model routing and fallbacks, latency and cost budgets, prompt and context versioning, caching, and quality and reliability monitoring.
  • Use AI coding agents throughout development while owning the outcome — the design, specifications and test plans, code review, and verification of correctness, security, and maintainability — and ship major changes behind automated tests and controlled rollouts, with product and legal-domain validation where appropriate.
  • Build scalable backend services and APIs, produce technical design documentation, and partner with product, research, and security stakeholders.
  • Participate in the on-call rotation; diagnose and resolve production incidents affecting model and agent services, and turn findings into durable fixes.
  • Senior+ level: Define the foundational architecture for running LLM-powered applications and agents reliably in production across teams, and lead the most complex cross-cutting initiatives, including migrations and addressing architectural debt and systemic risks.
  • Senior+ level: Raise the engineering bar by promoting best engineering practice, building reusable platform primitives, mentoring engineers, and partnering with product and engineering leaders on technical direction while staying hands-on and accountable for delivering working software.

Required Qualifications

  • 3+ years of professional software-engineering experience with demonstrated depth in backend, distributed, or AI systems. Hiring level will reflect demonstrated technical depth, scope of ownership, and impact.
  • Experience delivering and operating LLM-powered applications in production at scale — beyond prototypes or proofs of concept — including evaluating quality and diagnosing failures.
  • Experience building tool-using agent workflows or retrieval-augmented generation systems.
  • Strong production-level proficiency in Python.
  • Working understanding of the ML lifecycle, including evaluation data, model and dataset versioning, production deployment, and monitoring model quality, with the ability to collaborate with researchers on reliable model updates.
  • Experience designing evaluation datasets and benchmarks and measuring agent task completion, citation correctness, policy adherence, latency, and cost.
  • Experience designing services and APIs consumed by other engineering teams.
  • Experience with observability tooling such as Prometheus, Grafana, or OpenTelemetry.
  • Strong system-design and architecture experience, including production of technical design documents.
  • Excellent written and verbal communication, including the ability to work effectively with non-technical domain experts and stakeholders.
  • Demonstrated proficiency using AI coding agents in day-to-day development, with sound judgment about where they accelerate work and where they fail.
  • Self-motivated, with high ownership: you solve problems end to end, actively keep up with new developments in AI, and quickly learn and apply new technologies and approaches to your work, including areas you haven't worked in before.
  • Senior+ level: Demonstrated technical leadership at the corresponding level, with a track record of delivering complex distributed systems across multiple teams, and deep expertise in Python, distributed-systems fundamentals, and event-driven architectures.
  • Senior+ level: Proven ability to lead technical direction across organizational boundaries without direct authority, and to communicate architectural trade-offs to technical and non-technical audiences.

Preferred Qualifications

  • Experience training, fine-tuning, or adapting models to domain-specific tasks, including classification and extraction models and active-learning loops.
  • Experience building or contributing to public or domain-specific benchmarks for LLMs or agents.
  • Experience with large-scale data pipelines or document-processing systems.
  • Experience with multi-tenant SaaS architectures and data-isolation requirements.
  • Experience in a startup or scale-up engineering environment.
  • Experience in legal technology, enterprise workflow, or knowledge-management systems.

Candidates who meet most, but not all, of the qualifications above are encouraged to apply.

# LI-KS1 #1100 Epiq eDiscovery Solutions, Inc.

Technology Stack

Python · LLM APIs and agent frameworks (Anthropic via Amazon Bedrock, Azure OpenAI, in-house models) · Model Context Protocol (MCP) · Qdrant · Solr · PostgreSQL · RabbitMQ · Azure · Kubernetes · Docker · Prometheus · Grafana · OpenTelemetry

The Compensation range for this role is $180,000 -$260,000 USD annually and may be eligible for an annual bonus.

In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.

Must be authorized to work in the United States for any employer.

Your specific salary will be determined based on several factors:

  • Location-based market rate for the role
  • Your abilities in relation to the job specification
  • Performance during screening and interview
  • Pay parity with the wider team in the considered location

Further details about the package will be provided during the initial screening call with the Talent Acquisition Team.

Click here to learn about Epiq's Benefits.

Epiq Leadership Compass

Fosters Relationships & Collaboration

Builds trust and alignment through open communication, shared goals, and strong partnerships to drive collective success.

  • Build trust-based partnerships
  • Nurture long-term relationships
  • Remove collaboration barriers
  • Celebrate cross-team success

Engages & Influences

Inspires action and alignment through clear communication, purposeful influence, and a compelling vision.

  • Use storytelling to build buy-in
  • Align communication with organizational goals
  • Guild alignment through strong engagement

Maximizes Performance

Sets and reinforces performance standards that drive results, ensure accountability, and align with Epiq’s goals.

  • Use data to identify improvement opportunities
  • Make informed decisions
  • Align team goals with boarder strategy
  • Empower teams to manage their own goals
  • Translate vision into clear priorities
  • Prepare for disruptions with strong change management

Achieves Operational Success

Drives continuous improvement and operational excellence through smart processes, data insights, and quality execution.

  • Improve workflows for team efficiency
  • Use clear documentation and expectations
  • Resolve issues quickly using data and feedback

It is Epiq’s policy to comply with all applicable equal employment opportunity laws by making all employment decisions without unlawful regard or consideration of any individual’s race, religion, ethnicity, color, sex, sexual orientation, gender identity or expressions, transgender status, sexual and other reproductive health decisions, marital status, age, national origin, genetic information, ancestry, citizenship, physical or mental disability, veteran or family status or any other basis protected by applicable national, federal, state, provincial or local law. Epiq’s policy prohibits unlawful discrimination based on any of these impermissible bases, as well as any bases or grounds protected by applicable law in each jurisdiction. In addition Epiq will take affirmative action for minorities, women, covered veterans and individuals with disabilities. If you need assistance or an accommodation during the application process because of a disability, it is available upon request. Epiq is pleased to provide such assistance and no applicant will be penalized as a result of such a request. Pursuant to relevant law, where applicable, Epiq will consider for employment qualified applicants with arrest and conviction records.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against epiqsystems's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on epiqsystems's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    epiqsystems's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.