Skip to content

Open nowPosted 31 hours ago

Senior Data Engineer

Bidgely15 open roles

Where
India Head Office
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSenior Data EngineerBidgely · India Head Office
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Bidgely's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

13.9% of postings close within 7 days. Measured by our own scanner across the market. Bidgely postings stay open a median of 70 days.

Share of postings closed within
  1. 2.2%1 day
  2. 4.7%3 days
  3. 13.9%7 days
  4. 22.4%14 days
  5. 38.1%30 days
  6. 59.0%60 days
This job: posted 31 hours ago

Bidgely median: 70 days open

The posting

ROLES & RESPONSIBILITIES

- Play a key hands-on role in building and running central data platform features on Databricks and Snowflake, supporting the architects and managers who own the design and delivery.

- Design, build, and maintain scalable batch and streaming ELT/ETL data pipelines and large-scale datasets using Apache Spark with Python or Scala, Delta, Kafka and Airflow.

- Build AI agents and agentic data products on Databricks (for example Genie), Snowflake (for example Cortex) and LangGraph, and expose governed data to agents through MCP tools built with FastMCP.

- Implement automated data quality checks, end-to-end lineage tracking and RBAC security policies for the datasets you build, following the team’s data governance framework.

- Monitor and optimize Databricks and Snowflake compute and storage costs, and work within the team’s budget and spend-alert policies.

- Work closely with product managers, BI engineers, and data scientists to translate business requirements into scalable, well-modelled analytical solutions.

- Support data modelling initiatives using dimensional (Kimball) and normalized (3NF) techniques to serve AWB reporting and analytics needs.

- Contribute to CI/CD pipeline development for data workflows, including version control, automated testing, and deployment standards.

- Review code and share best practices on Databricks, Snowflake and data quality with the team. This is an individual contributor role with no direct reports.

- Translate architectural designs into high-quality, production-ready code by applying software design principles, design patterns, SOLID principles, and clean code practices. Build modular, reusable, loosely coupled, and testable components that support long-term scalability and maintainability.

WHAT YOU’LL DELIVER IN YOUR FIRST 12 MONTHS

- Deliver core data platform features end to end in production on Databricks and Snowflake, working with the architects and managers who own them.

- Deliver agent-ready datasets and tools that LangGraph agents and MCP tools use in production.

- Have data quality checks, lineage and RBAC in place for every dataset you build.

- Bring the compute and storage cost of the pipelines you build within agreed budgets.

WHAT YOU’LL BRING

- 5+ years of data engineering experience building central data platforms, large-scale pipelines, and production datasets; strong, hands-on proficiency in both Databricks and Snowflake is strictly required.

- Strong proficiency in Apache Spark using Python or Scala on Databricks, and in SQL on both Databricks and Snowflake, for core data processing workloads. Strong coding skills are required. This is a hands-on engineering role.

- Hands-on experience with Delta Lake as the primary table format, including MERGE, schema evolution, OPTIMIZE, VACUUM and performance tuning.

- Hands-on experience building streaming pipelines with Kafka and Spark Structured Streaming, including duplicates, late data, checkpoints and delivery guarantees.

- Production experience orchestrating batch and streaming workflows with Apache Airflow (mandatory), including retries, backfills, dependencies and alerting.

- Hands-on experience building AI agents with LangGraph (or LangChain) and with the agent features of Databricks and Snowflake, such as Genie and Cortex. Uses AI code-generation tools in day-to-day engineering work.

- Solid understanding of data governance concepts including data lineage, quality monitoring, regulatory compliance, RBAC, and governance frameworks.

- Experience building production-grade data pipelines on cloud platforms (AWS, Azure, or GCP) with a focus on reliability and observability.

- Good understanding of data modelling concepts including Kimball dimensional modelling, star/snowflake schemas, and 3NF normalization.

- Familiarity with CI/CD pipelines, Git-based workflows, and applying DevOps practices to data engineering projects.

- Strong communication and stakeholder management skills with an ownership mindset and ability to work independently across time zones.

BONUS SKILLS / NICE TO HAVE

- Exposure to Databricks and Snowflake Native Applications, data clean rooms, or Marketplace integrations.

- Experience implementing, testing and documenting dbt models for data reliability, lineage tracking and governance.

- Experience with other orchestration tools such as Prefect or dbt Cloud.

- Experience supporting BI/Analytics teams through semantic layer development (e.g., Looker, Tableau, or similar tools).

- Experience working in Agile/product-based development environments with sprint planning, backlog management, and iterative delivery.

- Databricks and Snowflake cost optimization experience: compute usage analysis, query profiling, clustering and partitioning design, materialized views, search optimization, resource monitors, budgets and spend alerts.

- Background in the energy, utilities, or IoT analytics domain is a strong differentiator.

- Exposure to MLOps concepts and production deployment workflows for data science models integrated with Databricks and Snowflake.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Bidgely's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Bidgely's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Bidgely's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.