Skip to content

Open nowPosted 30 days ago

Lead Data Engineer

MyCareersFuture94,028 open roles

Pay
SGD 10,000 – SGD 18,000 a Monthly
Where
Central, Singapore
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowLead Data EngineerMyCareersFuture · Central, Singapore
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on MyCareersFuture's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

7.7% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 1.6%1 day
  2. 3.3%3 days
  3. 7.7%7 days
  4. 14.0%14 days
  5. 33.7%30 days
This job: posted 30 days ago

The posting

As a Lead Data Engineer, you will provide technical leadership, incident management expertise, and strategic oversight in ensuring the reliability, security, and scalability of mission-critical data platforms. You will be responsible for defining and implementing best practices, influencing key stakeholders, and guiding the team in solving complex, high-priority technical challenges.

Job responsibilities

  • Work closely with cross-functional teams, including client systems and data engineers, to diagnose and resolve incidents impacting data operations, ensuring minimal business disruption.
  • Monitor, troubleshoot, and optimize data pipelines to ensure reliable and timely data delivery, addressing any issues encountered in production environments.
  • Use incident management tools, data monitoring metrics, and reports to detect issues and take corrective actions.
  • Enforce and monitor data quality metrics to maintain consistency, accuracy, and completeness across systems.
  • Leverage logging techniques for alerting, monitoring, and identifying root causes in data platforms and pipelines.
  • Optimize and modify data pipelines for scalability and performance improvements.
  • Support deployment of new features, bug fixes, and enhancements, ensuring smooth production integration and minimal risk.
  • Maintain documentation (troubleshooting guides, workflows, best practices) and mentor junior peers through technical and leadership guidance.
  • Follow standards and best practices to enhance operational efficiency, system stability, and availability.
  • Apply continuous delivery practices to support and deliver high-quality data solutions and customer value early and often.

Job qualifications

Technical Skills

  • Experience with data projects, including data frameworks, ETL processes, and data visualization.
  • Skilled in working with data models and pipelines to support smooth and efficient operations.
  • Proficient in MSSQL databases and AWS cloud-native services.
  • Strong hands-on experience with Python and Shell scripting.
  • Possess strong debugging and triaging skills to troubleshoot data issues effectively.
  • Experience building and supporting APIs within microservice architectures.
  • Familiar with data processing frameworks such as Apache Spark and Hadoop.
  • Practical experience with data science tools, including AWS SageMaker.
  • Comfortable working in Agile environments, including Scrum and/or Kanban.
  • (Desirable) Exposure to Java (Spring Boot), frontend frameworks like Angular/React, and knowledge of architectural styles such as monolithic, layered, microservices, and serverless.

Professional Skills

  • Strong communicator with the ability to articulate ideas clearly and influence others toward technical excellence.
  • Open-minded and adaptable to change while promoting best practices.
  • Resilient and able to navigate ambiguity by approaching challenges from different angles.
  • Experienced in mentoring and guiding junior consultants.
  • Willing to participate in a rotation-based, 24/7 support schedule as needed.

Other things to know

Learning and development

There is no one-size-fits-all career path at Thoughtworks: However you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys.

AI for recruitment

At Thoughtworks, we use AI tools to support our recruitment team with administrative tasks such as drafting communications, scheduling interviews and writing job descriptions.

Crucially, our AI tools do not screen, assess, rank or make hiring decisions. Every application is reviewed by our team and all selection decisions are made exclusively by our interviewers and hiring managers.

We are committed to fairness and responsible AI. We actively manage our AI systems by testing, monitoring for biased outcomes and implementing mitigation measures. We hold our third-party vendors to these same high standards through a rigorous governance process. For additional information, please see our full Thoughtworks AI Policy for Recruitment.

About Thoughtworks

Thoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. For 30+ years, we’ve delivered extraordinary impact together with our clients by helping them solve complex business problems with technology as the differentiator. Bring your brilliant expertise and commitment for continuous learning to Thoughtworks. Together, let’s be extraordinary.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against MyCareersFuture's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on MyCareersFuture's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    MyCareersFuture's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.