Skip to content

Open nowPosted 3 days ago

Data Engineer

MyCareersFuture94,028 open roles

Pay
SGD 9,000 – SGD 10,800 a month
Where
Central, Singapore
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowData EngineerMyCareersFuture · Central, Singapore
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on MyCareersFuture's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

7.7% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 1.6%1 day
  2. 3.3%3 days
  3. 7.7%7 days
  4. 14.0%14 days
  5. 33.7%30 days
This job: posted 3 days ago

The posting

Job Description

· We are looking for an experienced Data Engineer to join the delivery team for the EDW Reporting Modernisation project.

· You will be responsible for designing and building the Gold layer Data Mart tables, transformation pipelines, and associated views on the Unified Data Platform (Databricks), working closely with the Tech Lead and Data Modeler to deliver a robust and scalable reporting data layer that caters to Power BI reports.

· As the onshore Data Engineer, you will serve as the technical bridge between the Singapore-based design team and the offshore engineering squad, providing day-to-day technical direction, code review, and quality oversight across the full Data Mart build.

Key Responsibilities

· Design and Development::

o Develop Gold layer Data Mart tables and associated database views in Databricks in accordance with signed-off Source-to-Target Mapping (STTM) documents and design specifications

o Implement Silver-to-Gold transformation pipelines using Databricks Workflows, Delta Live Tables (DLT), and PySpark

o Create Delta table DDL in Unity Catalog, including schema definition, table properties, and column-level comments

o Implement SCD Type 2 merge logic for dimension tables and aggregation logic for fact tables per the grain specification

o Configure table partitioning, Z-ORDER clustering, and Liquid Clustering strategies for query performance optimisation

o Develop and implement data quality expectations using Delta Live Tables DQ framework per the DQ thresholds defined in the design specification

o Schedule and configure Databricks Workflow job DAGs for all pipeline runs, including watermark-based incremental load logic

· Testing and Quality Assurance::

o Conduct unit testing for each Data Mart table upon build completion — covering row count validation, null checks, duplicate grain checks, and transformation logic verification

o Execute system integration test (SIT) scenarios for all 60 Data Mart tables, including aggregated value checks, referential integrity validation, and SCD integrity checks

o Log, investigate, and resolve defects identified during SIT and UAT, performing root cause analysis and documenting fixes

o Review and validate unit test outputs from Pune Data Engineers before test results are submitted for Tech Lead review

· Offshore Squad Technical Leadership::

o Provide day-to-day technical direction and coding guidance to the 2 offshore-based Data Engineers

o Conduct code reviews for all pipeline and DDL code produced by the offshore squad before submission for Tech Lead sign-off

o Ensure offshore squad adherence to agreed coding standards, naming conventions, Unity Catalog governance rules, and development best practices

o Facilitate knowledge sharing and technical problem-solving with the Pune squad on complex transformation and merge logic

· Deployment and Handover::

o Execute Data Mart pipeline and table deployment to the production Databricks environment per the approved deployment runbook

o Validate the first production pipeline run and confirm data freshness post-deployment

o Contribute to the operational runbook covering pipeline architecture, job schedules, alert thresholds, and common failure scenarios

o Support knowledge transfer sessions with the Singtel IT operations team during the handover phase

Required Skills and Experience

· 5+ years of experience in data engineering with a strong focus on ETL/ELT pipeline development and dimensional data modelling

· Hands-on experience with Databricks — including Delta Lake, Delta Live Tables, Databricks Workflows, Unity Catalog, and Databricks SQL

· Proficiency in PySpark and Databricks SQL for large-scale data transformation

· Strong understanding of dimensional modelling concepts — star schema, SCD Type 2, surrogate key design, fact and dimension table design

· Experience implementing data quality frameworks and reconciliation testing

· Familiarity with Source-to-Target Mapping (STTM) and translating design specifications into production-grade pipelines

· Experience with incremental load patterns — watermark-based, partition-based, or CDC-driven

· Proficiency in Git-based version control for collaborative development

· Experience with Databricks Unity Catalog access control, table tagging, and lineage tracking

· Exposure to Oracle-to-Databricks migration projects or similar platform modernisation programmes

· Familiarity with Power BI Semantic Models and how Gold layer table design impacts downstream DAX measure performance

· Experience with Databricks Assistant or AI-assisted code generation tools for accelerated pipeline development

· Knowledge of CI/CD pipeline setup for Databricks notebook or YAML

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against MyCareersFuture's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on MyCareersFuture's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    MyCareersFuture's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.