Skip to content

Open nowPosted 14 hours ago

[C3A] Senior Data Platform Engineer (Microsoft Fabric)

Software Mind48 open roles

Where
Warsaw, Masovian Voivodeship, Poland, Remote
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen now[C3A] Senior Data Platform Engineer (Microsoft Fabric)Software Mind · Warsaw, Masovian Voivodeship, Poland, Remote
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Software Mind's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

10.5% of postings close within 7 days. Measured by our own scanner across the market. Software Mind postings stay open a median of 10 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.3%3 days
  3. 10.5%7 days
  4. 15.9%14 days
  5. 34.1%30 days
This job: posted 14 hours ago

Software Mind median: 10 days open

The posting

Company Description

Software Mind develops solutions that make an impact for companies around the globe. Tech giants & unicorns, transformative projects, emerging technologies and limitless opportunities – these are a few words that describe an average day for us. Building cross-functional engineering teams that take ownership and crave more means we’re always on the lookout for talented people who bring passion and creativity to every project. Our culture embraces openness, acts with respect, shows grit & guts and combines cooperation with enjoyment.

Job Description

Project – the aim you’ll have

Client is building a next-generation risk analysis and scoring platform on Microsoft Fabric, and this role owns its medallion data architecture end-to-end. You'll design and build Bronze / Silver / Gold Delta tables, Fabric Spark feature pipelines, Direct Lake semantic models, and physical-layout optimizations. This is our highest-utilization engineering role on the project — central to both Phase 1 platform foundation and Phase 2 risk product delivery, working alongside a Senior Technical Lead, Senior DevOps engineer, and mid-level developer.

The platform ingests transaction and merchant data from clients via SFTP and API, tokenizes sensitive PAN data at the ingestion boundary using our reserved-BIN HMAC-derived format-preserving scheme, and lands data in canonical Silver on Microsoft Fabric per our internal canonical spec. You'll build the pipeline that populates canonical Silver via MERGE, consume it via OneLake shortcuts, and materialize risk-specific Gold tables that feed both custom-authored DMN rules and pre-scored Mastercard Brighterion feeds.

Role – how you’ll contribute

  • Design and implement Bronze, canonical Silver, and Gold Delta table schemas with PAN-safe physical layout — statistics allowlist configuration, liquid clustering, deliberate retention settings, V-Order optimization.
  • Build Fabric Spark notebooks for the feature pipeline (rolling velocity features across 24h / 7d / 30d windows, merchant-level rolling features, hierarchical rollups, cross-merchant features via pan_token joins).
  • Author per-flavor-version Silver adapters — one function per flavor, unioned by name, tested against golden fixtures.
  • Build the canonical MERGE DAG (Bronze → canonical Silver, idempotent on _natural_key per Aperia's canonical Fabric internal spec v1.4).
  • Build the Gold materialization pipeline for both grains (fact_transaction_risk, fact_merchant_risk) with correct score-source stamping and idempotent merge semantics.
  • Design and implement Direct Lake semantic models per reporting surface; performance-test against representative data volumes.
  • Configure OneLake namespace layouts, workspace catalogs, and cross-workspace shortcut relationships with the residuals programme.
  • Establish idempotent Delta write patterns using delta-rs from Python containers (segmented parallel writes with single atomic commit).
  • Fabric capacity sizing (F-SKU selection, load testing, Reservation vs PAYG decisions).
  • Partner with the DevOps engineer on Fabric IaC (Terraform capacity provisioning plus Fabric REST workspace bootstrap).
  • Consult on ClickHouse contingency if Direct Lake latency proves insufficient for client-tier UIs.

Qualifications

Expectations – the experience you need

  • 5+ years data engineering experience, with at least 2 years hands-on Spark development (PySpark preferred).
  • Deep Delta Lake internals knowledge — transaction log format, checkpoints, retention settings (logRetentionDuration, deletedFileRetentionDuration), VACUUM, OPTIMIZE, deletion vectors, statistics collection.
  • Parquet format expertise — footers, statistics allowlists, row-group sizing, dictionary encoding, column indexes.
  • Microsoft Fabric hands-on experience — workspaces, capacities, notebooks, lakehouses, semantic models, Direct Lake, SQL analytics endpoint.
  • SQL performance tuning skills for both OLAP (Fabric) and OLTP (PostgreSQL) workloads.
  • Strong Python data engineering skills — pandas, PyArrow, delta-rs.
  • Ability to communicate architecture clearly in writing and to work autonomously on well-scoped features.

Additional skills – the edge you have

  • PCI-scoped data platform experience.
  • Financial services or payments domain background.
  • Power BI semantic model authoring (DAX).
  • Familiarity with published data-standard governance patterns — logical model vs physical profile, SCD2 dimensions, natural-key idempotency, extension attribute stores.
  • OneLake shortcuts and cross-workspace lakehouse patterns.
  • ClickHouse or similar OLAP engine familiarity.
  • Terraform for Azure data resources.
  • Prior experience with fluid or schema-flexible ingestion patterns.

Additional Information

What we offer:

  • Flexible and remote cooperation options
  • International projects with leading global clients
  • Travels related to international projects
  • Non-corporate atmosphere
  • Access* to language classes
  • Access* to knowledge-sharing initiatives
  • Access* to private healthcare and life insurance
  • Access* to multisport card

*The availability and terms of individual benefits may vary depending on the chosen form of cooperation.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Software Mind's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Software Mind's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Software Mind's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.