Skip to content

Open nowPosted 221 days ago

Data Engineering Lead

Workable (global search)108,016 open roles

Where
Suitland-Silver Hill, MD, United States
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowData Engineering LeadWorkable (global search) · Suitland-Silver Hill, MD, United States
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Workable (global search)'s own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

7.9% of postings close within 7 days. Measured by our own scanner across the market. Workable (global search) postings stay open a median of 7 days.

Share of postings closed within
  1. 1.6%1 day
  2. 3.6%3 days
  3. 7.9%7 days
  4. 14.9%14 days
  5. 34.0%30 days
This job: posted 221 days ago

Workable (global search) median: 7 days open

The posting

Position Overview

The Data Engineering Lead is responsible for designing and implementing modern, scalable data architectures to support migration of legacy, file-based analytical systems to AWS Cloud Native environments.

This role leads the transformation of legacy SAS-based data storage models—including flat files, batch outputs, and subsystem-specific data artifacts—into structured, governed, and scalable data models optimized for cloud-native processing.

The Data Engineering Lead will ensure data integrity, performance, and visibility across a system-of-systems modernization initiative, while providing technical leadership for data modeling, ingestion patterns, validation frameworks, and transparency reporting.

Expert-level proficiency in Python and strong experience designing AWS-based data architectures are required.

Key Responsibilities

Legacy Data Discovery & Data Model Transformation

  • Participate in structured system inventory efforts to document:
  • Legacy file-based storage structures
  • SAS dataset dependencies
  • Subsystem data flows
  • Manual gating and handoff processes
  • Analyze legacy storage models and design target-state data models aligned to AWS Cloud Native architecture.
  • Replace file-driven batch dependencies with:
  • API-based ingestion
  • Event-driven workflows
  • Database-backed storage (e.g., Aurora/Postgres)
  • Define canonical data schemas and transformation standards.

Cloud-Native Data Architecture Design

  • Architect scalable AWS data pipelines using services such as:
  • S3
  • Glue
  • Lambda
  • EventBridge
  • SNS/SQS
  • Aurora/Postgres
  • Batch
  • Athena
  • Design data ingestion, staging, transformation, and validation workflows.
  • Establish schema management, versioning, and data lineage practices.
  • Optimize data storage for performance, scalability, and cost efficiency.
  • Support serverless and containerized data processing architectures.

Expert Python-Based Data Engineering

  • Develop advanced Python-based data transformation and validation pipelines.
  • Implement modular, reusable data processing components.
  • Optimize large-scale data manipulation for distributed execution.
  • Develop high-performance ETL/ELT frameworks.
  • Embed automated validation checks directly into data pipelines.

Expert-level Python proficiency is required, particularly for:

  • High-volume data processing
  • Data validation logic
  • Modular data engineering frameworks

Data Accuracy, Validation & Visibility

  • Design and implement automated data validation frameworks to ensure:
  • Functional equivalence during migration
  • Record-level and aggregate-level consistency
  • Downstream compatibility across subsystems
  • Develop dashboards and reporting mechanisms providing:
  • Data accuracy metrics
  • Pipeline health indicators
  • Variance detection summaries
  • Enable transparency into data transformation impacts across modernization phases.
  • Support regression validation through golden datasets and automated comparisons.

System-of-Systems Data Coordination

  • Coordinate with Senior Developers and Requirements Engineers to align data models with application modernization.
  • Ensure upstream/downstream data contract stability.
  • Prevent data thrashing during phased migration.
  • Support orchestration of gated workflows through automated triggers rather than manual file exchanges.
  • Collaborate across workstreams to establish shared data standards.

DevSecOps & Governance Alignment

  • Integrate data pipelines into CI/CD frameworks.
  • Support infrastructure-as-code alignment (Terraform/CloudFormation collaboration).
  • Ensure compliance with security controls (IAM, encryption, key management).
  • Produce documentation supporting:
  • Architecture review boards
  • Interface control documents
  • Data flow diagrams
  • Support ATO-related data validation evidence.

Requirements

Required Qualifications

  • 8+ years of experience in data engineering or data architecture.
  • Expert-level proficiency in Python for data engineering.
  • Demonstrated experience transforming legacy file-based systems into cloud-native data architectures.
  • Experience developing data models for high-volume, data-intensive applications.
  • Deep experience with AWS data services (Glue, Lambda, S3, Aurora/Postgres, EventBridge, etc.).
  • Experience designing scalable ETL/ELT pipelines.
  • Experience building analytical dashboards (e.g., QuickSight or equivalent).
  • Experience implementing automated data validation and quality controls.
  • Experience working in Agile Scrum Teams.
  • U.S. Citizenship required.

Preferred Qualifications

  • Experience modernizing SAS-based data environments.
  • Experience supporting system-of-systems integration programs.
  • Experience implementing data lineage and metadata management.
  • Experience operating in regulated or federal environments.

Key Competencies

  • Systems-level thinking across data ecosystems
  • Strong schema design and normalization expertise
  • Data accuracy and integrity focus
  • Automation-first mindset
  • Cross-workstream coordination capability

Benefits

  • 401(k) with matching and 100% Vested
  • Health Insurance - 3 plans to select from
  • Dental insurance
  • Vision Insurance
  • Health savings account
  • Life insurance
  • Short Term Disability
  • Long Term Disability
  • AD&D
  • Paid time off
  • Professional development assistance
  • Training
  • Tuition reimbursement
  • Flexible schedule
  • Flexible spending account
  • Referral program
  • Paid Legal Plan
  • and more....

Ignite IT is an Equal Employment Opportunity/Affirmative Action Employer. We evaluate qualified applicants without regard to race, color, religion, sex, national origin, disability, Veteran status, sexual orientation, or other protected characteristic. In accordance with EO 13665 Final Rule, Ignite IT will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant.

Applicants selected may be required to possess and maintain a government clearance

US CITIZENSHIP REQUIRED

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Workable (global search)'s own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Workable (global search)'s form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Workable (global search)'s answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.