Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 20 hours ago

LLM Platform Engineer

AllSpice5 open roles

Pay
$160,000 – $190,000 a year
Where
Boston
Work mode
Hybrid
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowLLM Platform EngineerAllSpice · Boston

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on AllSpice's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

9.0% of postings close within 7 days. Measured by our own scanner across the market. AllSpice postings stay open a median of 21 days.

Share of postings closed within
  1. 1.8%1 day
  2. 3.9%3 days
  3. 9.0%7 days
  4. 15.5%14 days
  5. 34.0%30 days
This job: posted 20 hours ago

AllSpice median: 21 days open

The posting

Help define the future of hardware development! At AllSpice, we're building the automation engine that powers the next generation of circuit design, enabling breakthroughs in smart vehicles, robotics, rockets, IoT, medical devices, and more.

We're creating the agile development environment for hardware engineers with a Git-friendly translation layer and automated CI/CD framework for native circuit designs. Think GitHub/GitLab + Copilot for electronics.

Our mission is to bring the same modern workflows that revolutionized software: version control, automation, and collaboration to the hardware world.

Learn more about our journey in TechCrunch https://techcrunch.com/2025/06/23/allspices-platform-is-the-github-for-electrical-engineering-teams/ and our recent Series A announcement https://www.prnewswire.com/news-releases/allspiceio-hardware-development-platform-raises-15m-series-a-round-to-launch-ai-agent-and-scale-new-enterprise-functionality-for-electrical-engineering-teams-302489862.html.

If you're passionate about building tools that empower teams and delight customers, and you want to shape the foundation of modern hardware DevOps, we'd love to meet you!

Read more at https://allspice.io

WHAT WILL YOU DO?

This is a senior, high-impact software engineering role at the intersection of AI platform development, data engineering, and full-stack product development. You will own the tooling, evaluation systems, and data platforms that make AllSpice's Generative AI team more effective. Your primary users will be internal engineers and product managers, with opportunities to build customer-facing experiences where they support our AI products.

We’re looking for someone who can identify the right problems, make thoughtful technical decisions, and take solutions from discovery through implementation, adoption, and ongoing improvement. As you build domain knowledge and establish the AI platform foundation, we’d also like you to grow into contributing directly to AllSpice’s core product alongside the product engineering team. This is an aspirational growth opportunity, not a prerequisite or the role’s initial primary focus.

You will:

- Partner with engineers and product managers to discover workflow bottlenecks, prioritize the highest-impact problems, and own solutions end-to-end—from requirements and architecture to rollout and iteration.

- Own the evaluation and observability layer for our AI products, including automated and human review workflows, regression detection, and comparisons across models, prompts, and pipelines. Make quality, cost, latency, usage, and customer outcomes visible and actionable.

- Build usable internal applications and self-service tools that help engineers and product managers inspect AI results, investigate failures, and provide feedback. Where useful, extend these capabilities into customer-facing experiences.

- Build and maintain scripts, reliable data pipelines, and integrations that connect internal systems, third-party services, LLMs, and Model Context Protocol (MCP) tools, with attention to data quality, schema evolution, and customer data privacy.

- Write clear documentation and communicate findings to both technical and non-technical audiences, including leadership and customers.

- Champion code quality, testing, and reliability across the tooling stack through reviews, mentorship, and thoughtful design.

EXAMPLE PROJECTS

- Build an internal evaluation workspace for DRCY, our AI design review product, that captures run configurations, inputs, outputs, and telemetry; compares model and prompt changes; and tracks quality, false positives, cost, and latency over time.

- Develop review workflows that let engineers and product managers inspect AI-generated findings, apply scoring rubrics, override automated scores, and investigate regressions—with opportunities to surface relevant insights and feedback workflows to customers.

- Create and maintain data pipelines that aggregate evaluation results, customer feedback, and telemetry into a unified analytics layer.

- Build scripting tools and automations to streamline the Gen AI team's development and testing workflows (e.g., batch evaluation runs, report generation).

- Design and implement RAG-based information repositories and tooling to capture component data and domain knowledge for use by our suite of AI products.

- Integrate with CI/CD systems (GitHub Actions) to surface AI insights directly in engineering workflows.

- Partner with infrastructure to measure cache effectiveness, usage, and cost, and use those insights to improve the reliability and efficiency of AI workflows.

- As an aspirational next step, contribute directly to core AllSpice product features—for example, integrating AI review findings and feedback into existing engineering workflows—in partnership with the product engineering team.

OUR STACK

- Languages: Python, TypeScript/JavaScript, SQL

- Analytics & Data: SQL databases (Postgres), Jupyter Notebooks, business intelligence/analytics tools

- AI/LLM: Langchain, Pydantic AI, Langfuse

- Web: Vue/TypeScript front-end, common web architectures and APIs

- Infrastructure: GitHub Actions for CI/CD, Docker Swarm & Terraform, AWS

  • Our Hub application is a soft fork of Gitea https://github.com/go-gitea/gitea
  • Go [server-side]
  • Vue/TypeScript Front-end

EXPECTATIONS

Our ideal candidate should have the following:

- 4+ years of software engineering experience with a focus on tooling, data platforms, or full-stack web development, with demonstrated senior-level ownership of systems or products that other people depend on.

- Strong SQL skills and experience designing data pipelines and storage schemas, handling data quality and schema evolution, and using data/analytics tools (e.g., Jupyter, Metabase, Looker, or similar BI platforms).

- Proficiency in Python scripting and automation for data pipelines, integrations, and internal tools.

- Experience building web applications or customer-facing tools using modern frameworks (e.g., Vue, React, TypeScript).

- Practical experience shipping or maintaining LLM-enabled systems and building infrastructure around them, such as evaluation pipelines, observability, or integrations. You understand non-determinism, quality and reliability challenges, and tradeoffs across cost, latency, and model performance.

- Excellent communication skills — you can translate technical findings into clear insights for engineers, product managers, and customers alike.

- A customer-first mindset: you think about the end-user experience and proactively seek feedback to improve the tools you build.

- Bachelor's degree or higher in a technology-related field, or equivalent practical experience.

- Project management skills with the ability to lead and collaborate with varied stakeholders to move projects forward.

- Comfort with ambiguity and autonomy: you independently identify problems, propose solutions, make pragmatic build-vs.-buy and architectural decisions, and bring stakeholders along in a fast-moving environment.

- (Preferred) Availability to work out of our flex offices in San Francisco or Boston on a hybrid basis (2–3 times/week), but we are flexible for the right candidate.

RELEVANT SKILLS

You don't necessarily have to be proficient in all of these, but the more you know, the better:

- Python, TypeScript, SQL

- Business analytics and data visualization tools

- Langchain, Pydantic AI, and LLM evaluation frameworks

- GitHub Actions development and CI/CD

- Common web architectures, APIs, and front-end frameworks (Vue, React)

- Monitoring and observability tools (e.g., Langfuse, DataDog, Grafana)

- Project management and stakeholder communication

BENEFITS

- Supportive and smart colleagues, flexible work, opportunity to make a big impact, competitive salary & equity, health, dental, vision, generous PTO, home office stipend.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against AllSpice's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on AllSpice's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    AllSpice's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.