Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 11 hours ago

Senior Databricks Migration Engineer

Jobgether4,394 open roles

Where
US
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSenior Databricks Migration EngineerJobgether · US

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Jobgether's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

7.8% of postings close within 7 days. Measured by our own scanner across the market. Jobgether postings stay open a median of 4 days.

Share of postings closed within
  1. 1.6%1 day
  2. 3.4%3 days
  3. 7.8%7 days
  4. 14.3%14 days
  5. 33.7%30 days
This job: posted 11 hours ago

Jobgether median: 4 days open

The posting

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Databricks Migration Engineer based in the United States.

This is a senior data engineering role focused on modernizing legacy data platforms and migrating SQL-centric workloads to the Databricks Lakehouse. You will lead the technical transformation of legacy SQL Server stored procedures and Azure Data Factory pipelines into scalable, distributed Lakehouse architectures. The role combines data engineering, cloud architecture, performance optimization, security, governance, and technical leadership. You will design reusable ETL/ELT frameworks and optimize data models and SQL workloads to deliver reliable, high-performance analytics through Power BI. A major focus will be establishing secure, cost-efficient, and well-governed Databricks environments using technologies such as Delta Lake and Unity Catalog. You will also guide internal teams through the migration by leading workshops, pair programming, code reviews, documentation, and knowledge transfer. This opportunity is well suited to an experienced data engineer who can bridge traditional data warehousing practices with modern Spark-based Lakehouse engineering.

Accountabilities:

  • Lead the migration of legacy SQL Server stored procedures and Azure Data Factory pipelines to Databricks Lakehouse and Delta Lake.
  • Translate traditional relational data warehouse architectures into scalable Bronze, Silver, and Gold Lakehouse frameworks.
  • Design reusable ETL/ELT frameworks using PySpark, Delta Live Tables (DLT), and Databricks Workflows.
  • Architect and optimize Gold Layer dimensional models and star schemas to maximize Power BI performance.
  • Optimize Databricks SQL Warehouses for high-concurrency, low-latency Power BI workloads across DirectQuery and Import modes.
  • Implement advanced Delta Lake optimization techniques, including Z-Ordering, data skipping, liquid clustering, and materialized views.
  • Define cluster sizing, auto-scaling, and serverless SQL compute standards to balance performance, reliability, and cost.
  • Build monitoring dashboards to track Databricks Unit (DBU) consumption and identify opportunities for cost optimization.
  • Establish effective partitioning strategies and file-size management practices within Delta Lake.
  • Design and implement data security and governance using Unity Catalog.
  • Enforce row-level and column-level security for Power BI users and internal analysts.
  • Align Lakehouse security with Microsoft Entra ID and enterprise RBAC standards.
  • Lead pair-programming sessions, technical workshops, and code reviews to help teams transition from SQL-centric to Spark-centric development.
  • Produce comprehensive technical documentation, including architecture diagrams, design patterns, and optimization playbooks.
  • Establish knowledge-transfer practices that enable internal teams to operate and enhance the platform independently after migration.
  • Communicate technical concepts effectively to both technical and non-technical audiences.
  • Manage work in an organized and timely manner while maintaining a strong attention to detail.
  • Bachelor’s degree or higher from an accredited college or university in Computer Science, Engineering, or a related technical field.
  • 5+ years of experience in data engineering, data system development, or related roles.
  • 5+ years of experience working with cloud platforms such as Azure, AWS, or GCP.
  • At least 1 year of experience leading complex, cross-functional data projects and technical teams.
  • Strong expertise in data engineering principles, data modeling, ETL processes, and data pipeline development.
  • Hands-on experience with Databricks Lakehouse, Apache Spark, Delta Lake, cloud-native databases, cloud storage, and distributed computing platforms.
  • Strong proficiency in SQL and Python/PySpark for data manipulation and pipeline development.
  • Experience with Azure Data Lake storage and processing services.
  • Experience designing, building, and optimizing data pipelines for ingestion, transformation, and loading.
  • Experience with data warehousing, dimensional modeling, enterprise data lakes, incremental data loads, metadata-driven ingestion, and data quality frameworks using PySpark.
  • Ability to identify and resolve complex data-related challenges.
  • Strong understanding of query performance optimization, scalability, and efficient data modeling.
  • Demonstrated ability to communicate effectively in both written and verbal formats with technical and non-technical stakeholders.
  • Strong organizational skills, attention to detail, and ability to complete assignments within established timelines.
  • Must be a U.S. citizen and able to obtain a Position of Public Trust clearance.
  • Must not have traveled outside the United States for a combined total of 6 months or more during the past 5 years and must have resided in the United States for the past 5 years.
  • Fully remote opportunity available to candidates throughout the continental United States.
  • Preference for candidates located locally, followed by candidates in the U.S. East Coast time zone.
  • Opportunity to contribute to a major data modernization and Lakehouse migration initiative supporting a Federal Government customer.
  • Senior-level technical ownership across architecture, engineering, optimization, security, and governance.
  • Opportunity to influence engineering practices and enable internal teams through mentoring and knowledge transfer.
  • Collaborative environment involving data engineers, analysts, technical teams, and other stakeholders.
  • Position includes the opportunity to work with modern technologies across Databricks, Spark, Delta Lake, Azure, Power BI, and Unity Catalog.
  • Equal opportunity and inclusive workplace environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Jobgether's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Jobgether's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Jobgether's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.