Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 114 days ago

Senior Databricks Engineer

DataBeat19 open roles

Where
Hyderabad
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSenior Databricks EngineerDataBeat · Hyderabad

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on DataBeat's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

11.5% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.0%1 day
  2. 4.3%3 days
  3. 11.5%7 days
  4. 18.1%14 days
  5. 35.6%30 days
  6. 44.6%60 days
This job: posted 114 days ago

The posting

Job Title: Senior Databricks Engineer

Experience Required: 8+ Years

Role Summary

We are seeking an experienced Senior Databricks Developer with 8+ years of experience in Data Engineering, Big Data, and Cloud Analytics solutions, including extensive hands-onexpertise in Databricks, Apache Spark, PySpark, SQL, and Delta Lake. The ideal candidate will be responsible for leading end-to-end data engineering projects, engaging directly with clients and business stakeholders, mentoring development teams, and delivering scalable, secure, and high-performance data platforms across Azure and AWS environments.

This role requires strong technical leadership, solution design capabilities, stakeholder management skills, and the ability to drive data transformation initiatives from requirements gathering through deployment and production support.

Technical Expertise

Databricks (PySpark, SQL, Notebooks, Workflows) , Apache Spark , Delta Lake , Python, Azure

Data Factory (ADF) ,Azure Synapse Analytics ,AWS S3, Glue, Lambda , Unity Catalog

MLflow ,Databricks Job Clusters ,CI/CD Pipelines ,GitLab / GitHub ,Data Governance & Data

Quality Frameworks, Power BI / Tableau , Data Cataloging ,Lakehouse Architecture ,Medallion

Architecture, Performance Tuning & Optimization

Key Responsibilities

• Lead the design, development, and implementation of enterprise-scale data engineering

solutions using Databricks, PySpark, SQL, and Delta Lake.

• Own end-to-end project delivery, including requirement gathering, solution design,

development, testing, deployment, and production support.

• Collaborate directly with clients, business stakeholders, architects, and product owners to

understand business requirements and translate them into scalable technical solutions.

• Conduct client discussions, solution workshops, effort estimations, technical presentations,

and architecture reviews.

• Design and implement scalable Lakehouse architectures and data platforms across Azure and

AWS cloud environments.

• Lead the development of high-performance ETL/ELT pipelines supporting both batch and

real-time data processing workloads.

• Drive best practices around coding standards, architecture governance, version control, CI/CD

implementation, and operational excellence.

• Architect and optimize Databricks Workflows, Job Clusters, Delta Tables, and Spark

applications to maximize performance and minimize infrastructure costs.

• Implement data governance frameworks using Unity Catalog, ensuring proper access controls,

lineage tracking, metadata management, and compliance standards.

• Mentor and guide junior and mid-level data engineers through code reviews, technical

coaching, and knowledge-sharing initiatives.

• Lead technical teams and coordinate project activities to ensure timely and successful project

delivery.

• Collaborate with Data Scientists, BI Teams, and Analytics stakeholders to enable advanced

analytics and machine learning use cases.

• Drive automation initiatives through Infrastructure as Code (IaC), DevOps practices, and

CI/CD pipelines.

• Establish monitoring, observability, and performance tracking frameworks for data platforms

and pipelines.

• Ensure security, compliance, data quality, and operational reliability across enterprise data

ecosystems.

• Prepare and maintain technical architecture documents, design specifications, implementation

guides, and operational runbooks.

Requirements

• 8+ years of experience in Data Engineering, Big Data, and Analytics platforms.

• Minimum 5+ years of hands-on experience working with Databricks, Apache Spark, PySpark,

and SQL.

• Strong expertise in designing and implementing enterprise-scale Data Lake, Lakehouse, and

Data Warehouse solutions.

• Deep understanding of Spark internals, cluster management, performance tuning, partitioning

strategies, and resource optimization.

• Extensive experience working with Delta Lake, schema evolution, ACID transactions, and

large-scale distributed data processing.

• Hands-on experience integrating Databricks with Azure (ADF, Synapse) and/or AWS (S3,

Glue, Lambda) services.

• Proven experience handling end-to-end project delivery and managing technical engagements

with clients and stakeholders.

• Experience leading development teams and mentoring engineers in enterprise environments.

• Strong understanding of data modeling, dimensional modeling, Medallion Architecture, and

modern data platform design principles.

• Expertise in implementing CI/CD pipelines, DevOps practices, and automated deployment

strategies.

• Experience with Unity Catalog or equivalent governance platforms.

• Excellent communication, stakeholder management, presentation, and client-facing skills.

• Ability to lead technical discussions, architecture reviews, and solution design workshops.

• Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a

related field.

Information Security & ISO 27001 Compliance

Security is at the heart of everything we do. In this role, you will be strictly required to uphold our Information Security Management System (ISMS) policies in alignment with ISO/IEC 27001 standards. Responsibilities include safeguarding sensitive asset data, completing mandatory security awareness training, reporting potential security incidents or vulnerabilities immediately, and ensuring that daily operations comply with our rigorous data protection protocols.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against DataBeat's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on DataBeat's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    DataBeat's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.