Skip to content

Open nowPosted 32 days ago

Databricks Developer

DataBeat20 open roles

Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowDatabricks DeveloperDataBeat
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on DataBeat's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

11.8% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.1%1 day
  2. 4.4%3 days
  3. 11.8%7 days
  4. 18.6%14 days
  5. 35.6%30 days
  6. 45.1%60 days
This job: posted 32 days ago

The posting

Job Title: Databricks Developer

Experience Required: 5+ Years

Technical Knowledge:

Databricks (PySpark, SQL, Notebooks), Delta Lake, Apache Spark, Python, Azure Data Factory (ADF), Azure Synapse Analytics, AWS S3, Glue, Lambda, CI/CD Pipelines, GitLab, Data Quality Tools, Power BI/Tableau, Data Cataloging, Data Governance, Unity Catalog, MLflow, Job Clusters

Role Summary:

We are seeking a Databricks Developer with over 5 years of experience in building and optimizing scalable data pipelines using Databricks and Apache Spark. This role requires strong expertise in PySpark, Delta Lake, and cloud-native data engineering across Azure and/or AWS. You will lead the development of real-time and batch data solutions, contribute to data architecture, and ensure high performance, cost efficiency, and reliability across platforms. The ideal candidate is passionate about distributed computing, clean code, and modern data stack automation.

Key Responsibilities:

  • Design, build, and optimize robust ETL/ELT pipelines on Databricks using PySpark, SQL, and Delta Lake.
  • Lead the development of reusable and modular Notebooks, Jobs, and Workflows for both batch and streaming workloads.
  • Collaborate with data architects and engineers to build scalable data lakes and data warehouse layers on cloud platforms.
  • Implement best practices for coding standards, version control, testing, and performance tuning in Databricks.
  • Use Unity Catalog to manage metadata, lineage, access policies, and data governance across workspaces.
  • Integrate Databricks with orchestration tools like ADF, AWS Glue, or Airflow, depending on the environment.
  • Build and manage CI/CD pipelines using GitLab, GitHub Actions, or other DevOps tools for automated deployments.
  • Work with business users and data scientists to develop high-performance pipelines for analytics and ML models.
  • Monitor and troubleshoot Databricks Jobs, Job Clusters, and compute usage, optimizing for cost and speed.
  • Ensure security and compliance across data assets, leveraging row-level security, tokenization, and audit logging.
  • Maintain comprehensive documentation of pipelines, job configs, and data processing logic.

Requirements:

  • 5+ years of hands-on experience working with Databricks, building scalable, distributed data pipelines using PySpark and SQL.
  • Strong understanding of Apache Spark internals, cluster tuning, job performance optimization, and partitioning strategies.
  • Expertise in working with Delta Lake, schema evolution, and ACID-compliant data lakes.
  • Proficient in Python for scripting and data transformation, and SQL for data wrangling and analysis.
  • Experience integrating Databricks with Azure (ADF, Synapse) and/or AWS (S3, Glue, Lambda) environments.
  • Knowledge of Unity Catalog or similar governance tools for managing access, lineage, and policies.
  • Solid understanding of data modeling principles, especially for lakehouse and medallion architecture.
  • Experience implementing CI/CD pipelines and DevOps practices in a Databricks environment.
  • Strong communication skills to work with stakeholders, analysts, and engineers across teams.
  • Bachelor's or Master’s degree in Computer Science, Engineering, or a related technical field.

Preferred Skills:

  • Experience with Databricks Workflows, MLflow, and Job Clusters for advanced data science and automation use cases.
  • Familiarity with data observability tools and performance monitoring dashboards.
  • Knowledge of Power BI/Tableau and building semantic layers on top of Databricks SQL endpoints.

Information Security & ISO 27001 Compliance

Security is at the heart of everything we do. In this role, you will be strictly required to uphold our Information Security Management System (ISMS) policies in alignment with ISO/IEC 27001 standards. Responsibilities include safeguarding sensitive asset data, completing mandatory security awareness training, reporting potential security incidents or vulnerabilities immediately, and ensuring that daily operations comply with our rigorous data protection protocols.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against DataBeat's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on DataBeat's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    DataBeat's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.