Skip to content

Open nowFirst seen 5 days ago

Senior Data Engineer - Databricks & Streaming - Healthcare AI (Onsite, Evening Shift, Lahore, PKR Salary)

HR POD - Hiring Talent Globally47 open roles

Where
Lahore, Pakistan
Work mode
On site
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSenior Data Engineer - Databricks & Streaming - Healthcare AI (Onsite, Evening Shift, Lahore, PKR Salary)HR POD - Hiring Talent Globally · Lahore, Pakistan
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on HR POD - Hiring Talent Globally's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.3% of postings close within 7 days. Measured by our own scanner across the market. HR POD - Hiring Talent Globally postings stay open a median of 1 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.3%7 days
  4. 19.3%14 days
  5. 35.6%30 days
  6. 58.1%60 days
This job: first seen 5 days ago

HR POD - Hiring Talent Globally median: 1 days open

The posting

Requirements:

  • 4+ years of experience in data engineering, with substantial production experience in Databricks.
  • Strong experience with Spark SQL, PySpark, Delta Lake, Medallion Architecture, and Delta Live Tables (DLT).
  • Hands-on experience with Structured Streaming or equivalent production-grade streaming ingestion using Azure Event Hubs, Kafka, or Kinesis.
  • Strong understanding of checkpoint recovery, watermarking, and deduplication strategies.
  • Demonstrated experience debugging source-to-warehouse data discrepancies.
  • Ability to walk through a real-world incident involving mismatched record counts and explain how the root cause was identified and resolved.
  • Proven experience integrating third-party REST APIs in production.
  • Experience handling pagination edge cases, rate and row limits, retries, and schema drift.
  • Experience with entity resolution or data matching involving messy, real-world text data.
  • Experience with a metrics or semantic layer such as Holistics AML/AQL, dbt Metrics, or LookML.
  • Working understanding of why non-additive measures cannot be reliably calculated from pre-aggregated rollups.
  • Strong SQL and Python skills, with the ability to own data pipelines end-to-end with minimal oversight.
  • Strong written and spoken English, with the ability to collaborate effectively with a US-based team asynchronously.
  • Healthcare data experience, including referrals, payer taxonomy, claims/eligibility, or other PHI-adjacent datasets.
  • Familiarity with HIPAA handling expectations.
  • Experience with voice-agent, call-center, or telephony/conversation data.
  • Familiarity with call transcripts and containment or outcome metrics.
  • Hands-on experience with Holistics, specifically AML/AQL modeling.
  • Experience with the broader Azure ecosystem beyond Event Hubs, including ADLS, ADF, and Key Vault.

Responsibilities:

  • Build and maintain resilient ingestion pipelines for third-party vendor REST APIs.
  • Work primarily with voice-AI observability and telephony platforms.
  • Handle different pagination schemes, including offset/limit and page/cursor models.
  • Manage row and rate limits through time-windowing and adaptive bisection.
  • Implement robust schema-drift handling through contract and column-presence checks.
  • Ensure alerts are triggered when fields are renamed, moved, or removed rather than silently propagating null values.
  • Own streaming ingestion from Azure Event Hubs into Databricks using Structured Streaming and/or Auto Loader.
  • Manage checkpoints and offsets, watermarking, and at-least-once deduplication.
  • Perform source-parity reconciliation across ingested and production data.
  • Investigate row counts, dropped or duplicated events, late-arriving data, and schema mismatches.
  • Identify and resolve the root cause when ingested data does not match production sources.
  • Develop and maintain Delta Lake pipelines using a Medallion Architecture (Bronze Silver Gold).
  • Use Spark SQL and PySpark to build and maintain production data pipelines.
  • Implement idempotent MERGE upserts.
  • Work with Delta Live Tables and materialized-view constraints, including CREATE OR REFRESH and LIVE references.
  • Understand and manage differences between DLT and job execution contexts.
  • Build entity-resolution pipelines for dirty, free-text data.
  • Normalize practice, provider, and payer names using regex, canonical dictionaries, fuzzy matching, confidence-scored crosswalks, and override tables.
  • Maintain the semantic and metrics layer with rigorous metric definitions.
  • Define and maintain accurate denominators, data grain, and cohort boundaries.
  • Ensure the correct handling of non-additive aggregates, including medians and percentiles that cannot be reliably supported through aggregate-aware pre-aggregation.
  • Ensure every metric remains accurate and reproducible.
  • Instrument data quality across the entire pipeline.
  • Monitor data freshness, source parity, data contracts, and other critical quality checks.
  • Build alerting mechanisms that identify data issues before they reach dashboards.
From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against HR POD - Hiring Talent Globally's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on HR POD - Hiring Talent Globally's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    HR POD - Hiring Talent Globally's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.