Skip to content

Open nowFirst seen 3 hours ago

Senior Databricks Migration Engineer

ECS FEDERAL LLC258 open roles

Where
Work from home, VA, USA
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSenior Databricks Migration EngineerECS FEDERAL LLC · Work from home, VA, USA
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on ECS FEDERAL LLC's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

11.3% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.0%1 day
  2. 4.2%3 days
  3. 11.3%7 days
  4. 17.5%14 days
  5. 34.2%30 days
  6. 43.5%60 days
This job: first seen 3 hours ago

The posting

ECS is seeking a Senior Databricks Migration Engineer to work in our Arlington, VA (hybrid) office. Please Note: This position is contingent upon additional funding.

The individual serves as the authoritative resource for the agency who specializes in preparing big data infrastructure for analytical or operational uses. They are responsible for designing and creating systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret and enables the agency to make smarter decisions and optimize operations.

Responsibilities include:

  • Lead the technical migration from legacy SQL Server stored procedures and ADF pipelines to Databricks Lakehouse (Delta Lake), ensuring best practice Lakehouse design.
  • Translate traditional relational data warehousing paradigms into scalable, distributed Lakehouse frameworks (Bronze, Silver, Gold).
  • Design robust, reusable ETL/ELT frameworks using PySpark, Delta Live Tables (DLT), and Databricks Workflows.
  • Architect and refine the Gold Layer (dimensional models, star schemas) specifically to maximize Power BI performance.
  • Optimize Databricks SQL Warehouses to support high-concurrency, low-latency Power BI queries (DirectQuery and Import modes).
  • Implement advanced optimization techniques, including Z-Ordering, data skipping, liquid clustering, and materialized views.
  • Define and enforce governance standards for cluster sizing, auto-scaling policies, and serverless SQL compute to balance performance with cost.
  • Implement proactive monitoring dashboards to track Databricks Unit (DBU) consumption and identify cost-saving opportunities.
  • Establish best practices for partition strategies and file size management within Delta Lake.
  • Design and implement a robust data security model using Unity Catalog for centralized governance.
  • Enforce row-level and column-level security policies to ensure compliant data access for Power BI consumers and internal analysts.
  • Align the Lakehouse security architecture with existing enterprise Azure Active Directory (Microsoft Entra ID) and RBAC standards.
  • Act as the primary technical lead, conducting dedicated pair-programming sessions, workshops, and code reviews to transition the team from SQL-centric to Spark-centric thinking.
  • Create comprehensive technical documentation, including architecture diagrams, design patterns, and optimization playbooks.
  • Build a foundational knowledge transfer framework to ensure the internal team is fully self-sufficient post-migration.
  • Communicate effectively verbally and in written form to both technical and non-technical audience.
  • Work in an organized fashion, completing tasks timely while paying close attention to details.

Salary Range: $150,000-$160,000

General Description of Benefits

  • Bachelor's degree or higher from an accredited college or university in Computer Science, Engineering, or a related technical field.
  • 5+ years’ experience in data engineering, data system development or related roles.
  • 5+ years’ experience with cloud platforms (e.g. Azure, AWS, GCP).
  • 1+ year leading complex, cross-functional data projects and technical teams.
  • Experience with Databricks Lakehouse, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms.
  • Experience with data warehousing, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
  • Mastery of data engineering principles, including data modeling, ETL (Extract, Transform, Load) processes, and data pipelines.
  • Proficiency with Azure Data Lake data storage and processing services.
  • Skilled at designing, building, and optimizing data pipelines for ingesting, transforming, and loading data.
  • Proficiency in languages such as SQL and Python/PySpark for data manipulation and pipeline development.
  • Skilled at identifying and resolving data-related challenges.
  • Skilled at creating efficient data models that meet business requirements.
  • Skilled at optimizing query performance and system scalability.
From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against ECS FEDERAL LLC's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on ECS FEDERAL LLC's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    ECS FEDERAL LLC's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.