Skip to content

Open nowPosted 11 days ago

Consultant - PySpark / Databricks Developer (Junior to Intermediate)

electricmind15 open roles

Pay
CA$80,000 – CA$120,000 a year
Where
Downtown Toronto
Work mode
Hybrid
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowConsultant - PySpark / Databricks Developer (Junior to Intermediate)electricmind · Downtown Toronto
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on electricmind's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

7.7% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 1.4%1 day
  2. 3.5%3 days
  3. 7.7%7 days
  4. 13.4%14 days
  5. 34.5%30 days
This job: posted 11 days ago

The posting

At Electric Mind, Engineering is where strategy meets action. Our team helps organizations cut through complexity—aligning business ambition with technology execution to unlock real, lasting change. You’ll work alongside curious, driven people tackling high-impact challenges for everyone from scaling startups to global enterprises. Each engagement is different, pushing you to learn, adapt, and grow.

Electric Mind’s Technology Practice brings together deep engineering expertise, modern delivery disciplines, and pragmatic architectural thinking to help clients execute complex, mission-critical transformation. We design and implement scalable, secure, high-impact technology solutions that accelerate business outcomes.

About the Role

We are looking for both permeant and contract for this role.

We're looking for a developer to help build and maintain data pipelines on Databricks for a financial services / wealth management data platform. The platform ingests data from multiple source systems, transforms it through a medallion architecture (bronze → silver → gold) using PySpark, and publishes curated data to downstream consumers via file exports and Kafka. You'll work alongside a senior engineer, writing transform code, fixing pipeline issues, and helping keep the environment healthy across dev/qa/uat.

This is a good fit for someone with solid Python fundamentals and some Spark/SQL exposure who wants to grow into a data engineering specialist. You won't be expected to know Databricks internals on day one — you will be expected to learn fast, ask good questions, and write clean,

What You'll Work On

  • Writing and maintaining PySpark transforms (hand-written, not a generic framework) for silver and gold layer tables — things like customer, account, and transaction data models.
  • Working with Lakeflow Declarative Pipelines (Databricks' current pipeline framework — successor to DLT) and Auto CDC / SCD Type 2 patterns for change-data-capture merges.
  • Querying and validating data in Unity Catalog across environments (dev/qa/uat) using SQL warehouses.
  • Debugging failed pipeline runs: reading pipeline event logs, tracing bad records, fixing schema drift or data quality issues.
  • Maintaining reference/lookup tables and small utility scripts (PowerShell/Python) used to operate the platform.
  • Writing and updating unit/integration tests for transform logic.
  • Participating in code review, using Git feature branches and merge requests (GitLab).
  • Keeping documentation current when you change how something works.

Must-Have Skills

  • Python — comfortable writing clean, readable code; understands functions, modules, basic OOP.
  • Some exposure to Apache Spark / PySpark, or strong SQL skills plus a willingness to learn Spark quickly.
  • Working knowledge of SQL (joins, aggregations, window functions).
  • Basic Git workflow: branches, commits, pull/merge requests.
  • Comfortable reading other people's code and stack traces, and debugging methodically (not guess-and-check).

Nice-to-Have Skills

  • Direct experience with Databricks (notebooks, jobs, clusters, or SQL warehouses).
  • Familiarity with Delta Lake, medallion architecture (bronze/silver/gold), or CDC/SCD concepts.
  • Exposure to Azure (this environment runs on Azure Databricks with Azure AD service principal auth).
  • Experience with Kafka or other streaming/event systems.
  • Experience with CI/CD pipelines (this project uses GitLab CI).
  • Prior work in financial services or a regulated data environment.

What Success Looks Like in the First 90 Days

  • Can independently pick up a small transform bug or enhancement ticket, make the change, test it, and open a merge request.
  • Comfortable running existing operational scripts to check pipeline status, query tables, and diagnose failures without hand-holding.
  • Starting to take ownership of the Databricks environments and help write new transforms

About Electric Mind

Electric Mind is a fast-growing, AI-native advisory and digital engineering firm built for those who want to shape the future, not just watch it happen. We blend premium strategy expertise with cutting-edge AI-centric engineering to solve complex, meaningful problems for industry-leading clients.

We pride ourselves on a high-touch delivery model and a culture that values diverse talent, innovation, and true client partnership — creating an environment where your ideas matter and your impact is visible.

If you’re looking for a place where you can grow fast, collaborate with exceptional teammates, and help build a company scaling its capabilities and global footprint at speed — Electric Mind is the place to ignite your career. The future is bright!

For more info on Electric Mind, check out our Careers Page and Instagram.

Electric Mind is committed to diversity in the workplace. We are an inclusive employer and welcome and encourage applications from all qualified candidates. Applicants’ needs will be accommodated during our recruitment and selection process so please advise us if you require accommodation.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against electricmind's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on electricmind's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    electricmind's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.