Skip to content

Open nowPosted 22 hours agoWe saw it 109 min after it went up

Data Platform Engineer, Ingestion

Minerva16 open roles

Pay
$170,000 – $236,000 a year
Where
New York City
Work mode
On site
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowData Platform Engineer, IngestionMinerva · New York City
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Minerva's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.1% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.1%7 days
  4. 19.1%14 days
  5. 35.6%30 days
  6. 52.7%60 days
This job: posted 22 hours ago

The posting

ABOUT MINERVA

Minerva builds AI for marketing leaders. We work together with marketers to automate and accelerate their workflows with AI agents. Our agents augment the end-to-end workflow of the marketer by automating analysis, campaign planning, activation, measurement and reporting.

Customers like the NBA, Ramp, Wander, Hard Rock Stadium Group and Luxury Presence use Minerva to develop a better understanding of their customers and introduce AI specifically built to understand the customer into their commercial organizations. Our campaigns outperform other tools because we built the entire stack: from identity to enrichment to data integration as well as agents to action and report on the analysis.

We've raised $20M from The General Partnership, 8VC, Lingotto, NBA Investments, Topology Ventures, Future Positive, Background Capital and many others. Our team brings together operators and investors from Citadel, Dentsu, Bridgewater, Meta Superintelligence, Growthloop, Amazon and Lazard, alongside engineers and researchers from Berkeley, MIT, Stanford and Cambridge.

THE ROLE

Every new data source starts as someone else's problem: an API with rate limits, a vendor file that arrives late and gets corrected twice, a schema that changes without warning. Today, adding a new vendor feed still takes hand-built work.

You make new sources dependable and make the next one cheap. You build the ingestion pipelines for our customer and vendor data, automate onboarding from configuration to first delivery, and turn what you build into modules other Minerva teams can use without running platform infrastructure themselves.

This is a mid-level individual contributor seat on the data platform team, reporting to our Head of Data Platform. Our data product team decides which sources matter and what good data looks like. You own how it arrives and how it stays dependable.

WHAT YOU'LL DO

- Build pipelines for messy sources. APIs, files, database extracts and approved scraping sources, at high volume, with inconsistent formats and schemas that change.

- Make reruns safe. Incremental loads, backfills and retries that never duplicate or corrupt data. Bad records get quarantined, not loaded. Throughput and processing cost stay under control.

- Automate onboarding. The path from source configuration and access checks through provisioning, validation, deployment and first delivery runs without hand-holding.

- Build modules other teams use. Reusable connectors and storage components with tests, examples and clear interfaces, so a team building an API integration or a scraper gets managed ingestion, storage and monitoring without building them.

- Keep the origin of every value. Carry source metadata through the pipeline (which vendor, which delivery, when) so we can always say where a value came from. Enforce privacy controls so restricted data can't come back through a new load or a replay.

- Own your integrations in production. Connect each one to shared monitoring, write its recovery runbook and fix source-specific problems when they break.

OUR STACK

- Orchestration: Dagster, with Airflow still running the workloads that haven't moved.

- Transformation: dbt and SQLMesh.

- Storage: Snowflake, plus a lakehouse on Spark, Iceberg, Trino and AWS Glue.

- Code: Python on AWS.

WHAT YOU HAVE

- Typically three or more years building and supporting production data pipelines, or equivalent ownership.

- You've brought in data from many vendors and source types, including messy data at scale, and kept it running after launch.

- Practical judgment about incremental processing, backfills, failures and cost. You can show the data stayed correct as volume grew.

- You've automated repeated work or built components other engineers actually used.

- Strong Python and SQL.

- You pin down what a source owner actually needs, and you write down what you will and won't support.

- You're in New York City or willing to relocate.

NICE TO HAVES

- Connector frameworks, whether off the shelf or your own.

- Onboarding automation or self-service data tooling.

- Consumer, identity or contact data, and the privacy rules that come with it.

- Dagster, Iceberg or Snowflake in production.

YOU MIGHT BE A FIT IF YOU ARE…

- A data engineer at a data vendor or identity company who has onboarded source after source and wants to build the framework instead of the next one-off.

- An engineer at a connector, integration or reverse-ETL company who has built connectors other people depend on.

- A data engineer at a fintech, marketplace or adtech company who became the person every new integration ran through.

- Or you don't fit any of these neatly, but you've taken data you didn't control and made it dependable. Apply.

WHAT SUCCESS LOOKS LIKE

- First 90 days: a new source is live through automated onboarding you built, and another engineer has onboarded a different source with the same modules. You've measured the setup effort and tested recovery.

- First 6 months: teams outside data platform bring in new sources through your modules, and every feed you own has alerting and a recovery runbook a second engineer has used.

- The numbers you own: time to onboard a new source, and how often a feed needs hands-on recovery.

COMPENSATION

$170,000–$236,000 base salary, depending on level. Meaningful equity. Medical, dental and vision.

HOW TO APPLY

Skip the cover letter. Walk us through one pipeline you built for data you didn't control: the source, what broke, how you made reruns safe and how the next source got easier. A few paragraphs. Applications without it won't be reviewed.

WHERE WE WORK

We work in person from our office at 300 Kent Avenue in Williamsburg, Brooklyn.

BENEFITS

Every full-time role includes equity; medical, dental and vision coverage; unlimited PTO; a monthly fitness stipend; and an annual company offsite. We'd rather pay people well than buy perks nobody uses.

PAY TRANSPARENCY

The salary range in this posting is our good-faith range for the role in New York City at the time of posting. Where an offer lands depends on the level and experience we see in the interview process.

APPLYING

Apply on this page. We don't take applications by email, and we don't accept unsolicited submissions from recruiting agencies. If you need an accommodation at any point in the process, write to [email protected].

WORK AUTHORIZATION

You'll need to be authorized to work in the United States. We consider visa sponsorship case by case, so tell us on the application if you'll need it.

EQUAL OPPORTUNITY

Minerva is an equal opportunity employer. We make hiring decisions without regard to race, color, religion, creed, sex, pregnancy, sexual orientation, gender identity or expression, national origin, citizenship status, age, disability, marital status, veteran status or any other characteristic protected by federal, New York State or New York City law.

RECRUITMENT FRAUD

Our hiring runs through Ashby and @minerva.io email addresses. We will never ask you for money, bank details or other financial information during the process. If a message claiming to be from Minerva looks wrong, forward it to [email protected].

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Minerva's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Minerva's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Minerva's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.