Skip to content

Open nowPosted 11 hours ago

Senior Data Engineer

8allocate10 open roles

Where
Remote
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSenior Data Engineer8allocate · Remote
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on 8allocate's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.4% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.4%7 days
  4. 20.0%14 days
  5. 35.5%30 days
  6. 58.6%60 days
This job: posted 11 hours ago

The posting

About the client:

The client is the leading Autonomous Decision Science company providing data-enabled prescriptive and anticipatory analytics and insights for companies across a broad range of industries. They automate a new way of problem-solving and decision-making, going beyond advanced analytics to understand data, perform analytics, generate insights, answer queries, and make decisions at the speed of the market. This powerful capability uniquely enables “End-to-End Value Chain Optimization and Decision-Making” at scale and allows clients to uncover and understand the inter-relationships that lead to innovative new product development and innovation, heightened consumer understanding and targeted marketing, revenue growth tactics, and intelligent demand and supply-chain planning. They help transform market-leading companies into true data-driven digital enterprises.

Timezone requirements: European working hours are okay; the client is in EST, and our team is in Europe.

English: Advanced level.

Requirements:

  • Minimum of 5 years of hands-on experience as a Data Engineer or in a similar position;
  • Minimum of 3 years of commercial experience with Python;
  • Minimum of 3 years of SQL and experience working with relational databases (Postgres preferred; similar OLTP DB is acceptable);
  • Experience with Python 3, Airflow, and Snowflake;
  • Demonstrated knowledge and experience developing data pipelines to automate data processing workflows;
  • Demonstrated experience in data modeling;
  • Demonstrated knowledge of data warehousing, business intelligence, and application data integration solutions;
  • Demonstratable experience in developing applications and services that run on Azure cloud infrastructure;
  • Strong skills with pandas and Pyspark/Spark;
  • Experience with container management and deployment, e.g., Docker and Kubernetes;
  • Excellent problem-solving and communication skills;
  • Ability to thrive in a fast-paced, remote environment;
  • Comfortable with ambiguity with the ability to build structure and take a proactive approach to drive results;
  • Attention to detail – quality and accuracy in deliverables.

The following additional skills would be beneficial:

  • Knowledge of one or more of the following technologies: Data Science, Machine Learning, Natural Language Processing, Business Intelligence, and Data Visualization;
  • Knowledge of statistics and experience using statistical or BI packages for analyzing large datasets (Excel, R, Python, Power BI, Tableau, etc.);
  • Experience with at least one of the following: Databricks, Spark, Hadoop, or Kafka;
  • FastAPI / Flask, or similar web backend framework experience;
  • Experience with some of the following: Celery, RabbitMQ, and ZeroMQ;
  • Other SQL or NoSQL experience: Redis, Elasticsearch, DuckDB, ClickHouse.

What you will do:

The successful candidate will join a diverse team to:

  • Build unique, high-impact business solutions utilizing advanced technologies for use by world-class clients;
  • Create and maintain the underlying data pipeline architecture for the solution offerings from raw client data to final solution output;
  • Create, populate, and maintain data structures for machine learning and other analytics;
  • Use quantitative and statistical methods to derive insights from the data;
  • Combine machine learning, artificial intelligence (ontologies, inference engines, and rules), and natural language processing under a holistic vision to scale and transform businesses across multiple functions and processes.

Responsibilities Include:

  • Create and maintain an optimal data pipeline architecture, incorporating data wrangling and Extract-Transform-Load (ETL) flows;
  • Assemble large, complex data sets to meet analytical requirements – analytics tables, feature-engineering, etc.;
  • Build the infrastructure required for optimal, automated extraction, transformation, and loading of data from a wide variety of data sources using SQL and other ‘big data’ technologies;
  • Build automated analytics tools that utilize the data pipeline to derive actionable insights;
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.;
  • Design and develop data integrations and data quality framework;
  • Develop appropriate testing strategies and reports for the solution as well as data from external sources;
  • Evaluate new technology for use within the projects;
  • Work with the team and client personnel to administer and operate client-specific instances of the offerings;
  • Configure the data pipelines to accommodate client-specific requirements to onboard new clients;
  • Perform regular operations tasks to ingest new and changing data – implement automation where possible;
  • Implement processes and tools to monitor data quality – investigate and remedy any data-related issues in daily solution operations.

Tech stack: a technical stack of the project:

Backend

  • Programming Language: Python 3.11.2 (latest)
  • Package Manager: Poetry
  • Web Framework: FastAPI
  • Object-Relational Mapping (ORM): SQLAlchemy
  • Linting: ruff
  • Code Formatter: isort
  • Testing Framework: pytest
  • Property-based Testing: Hypothesis
  • Database: PostgreSQL

Frontend

  • Programming Language: TypeScript
  • Package Manager: PNPM
  • Framework: React
  • State Management: Zustand
  • Routing: React Router
  • Data Fetching: TanStack Query (successor to react-query)
  • Build Tool: Vite
  • Unit Testing: Vitest
  • Component Testing: React Testing Library
  • End-to-End Testing: Playwright
  • UI Kit (to be determined)
  • Linting: ESLint + typescript-eslint
  • Code Formatting: Prettier

And:

  • Docker and Docker Compose
  • Kubernetes
  • Airflow
  • Azure
  • Snowflake

Benefits from 8allocate:

  • Team & Culture: Team events, offsites, and a culture that keeps people connected.
  • Learning & Development: Budget for courses, certifications, and conferences.
  • Wellbeing: Flexible support in line with company policy, with options to support your physical and mental wellbeing (sport, mental health, or medical insurance).
  • Rest & Recovery: Paid vacation and sick leave.
From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against 8allocate's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on 8allocate's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    8allocate's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.