Skip to content

Open nowPosted yesterday

Lead Data Engineer

Brown & Brown307 open roles

Where
Plano, TX, USA
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowLead Data EngineerBrown & Brown · Plano, TX, USA
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Brown & Brown's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.3% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.3%7 days
  4. 19.7%14 days
  5. 35.6%30 days
  6. 58.0%60 days
This job: posted yesterday

The posting

Built on meritocracy, our unique company culture rewards self-starters and those who are committed to doing what is best for our customers.

Brown & Brown is seeking a Lead Data Engineer to join our growing team in Plano, TX!

As a Lead Data Engineer, you will play a key role in advancing our Data & AI platform capabilities by designing, building, and operating modern data solutions that power Artificial Intelligence, Machine Learning, analytics, business intelligence, and enterprise insights. This role combines hands-on engineering with technical leadership. You will partner with product owners, architects, business stakeholders, and engineering teams to translate business needs into pragmatic, production-ready data solutions.

You will own Data solutions across the engineering lifecycle, from architecture and design through development, deployment, and steady-state operations. You will establish engineering patterns and standards, improve platform capabilities, mentor engineers, resolve complex technical challenges, and help the team deliver reliable, governed, scalable, and cost-effective data products.

What Will You Do?

  • Lead the design, development, deployment, and operational support of scalable batch and streaming data solutions.
  • Design and build Databricks-native data engineering solutions using Delta Lake, Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader, Structured Streaming, and Unity Catalog.
  • Develop production-grade ingestion, transformation, and data-processing pipelines using Python, PySpark, Apache Spark, and SQL.
  • Define technical designs, engineering standards, and reusable patterns that improve scalability, reliability, maintainability, and developer productivity.
  • Build and maintain governed data solutions that improve the accuracy, consistency, accessibility, and trustworthiness of enterprise data.
  • Develop reusable frameworks, libraries, templates, and automation that accelerate data ingestion, transformation, feature engineering, and consumption.
  • Implement data-quality validation, monitoring, observability, and remediation capabilities for critical data assets.
  • Integrate data solutions with enterprise governance capabilities, including metadata, lineage, classification, certification, ownership, and access controls.
  • Develop governed data assets supporting AI, Machine Learning, advanced analytics, semantic models, APIs, Genie Spaces, and AI agents.
  • Troubleshoot and optimize production workloads using Spark diagnostics, job logs, query plans, partitioning strategies, join optimization, and Adaptive Query Execution.
  • Operate and continuously improve data solutions through performance monitoring, incident resolution, migrations, upgrades, observability, and cost optimization.
  • Implement automated infrastructure and environment-aware deployments using Infrastructure as Code, Git, and CI/CD practices.
  • Partner with product owners, architects, operations teams, and engineering teams to prioritize capabilities, address technical dependencies, and expand platform adoption.
  • Lead technical design discussions, perform code and design reviews, drive architectural alignment, and proactively identify and remove technical blockers.
  • Mentor engineers and foster a culture of engineering excellence, collaboration, continuous learning, and accountability.

Required Qualifications

  • Bachelor’s degree in computer science, Engineering, Mathematics, Information Systems, or a related STEM field, or equivalent education and professional experience.
  • 8+ years of experience in data engineering or related software/data engineering disciplines, including significant hands-on experience building and supporting production data solutions.
  • Strong hands-on experience with Databricks, Apache Spark/PySpark, Delta Lake, Python, and SQL. Experience designing and operating production-grade batch and streaming data pipelines. Experience with Databricks capabilities such as Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader, Structured Streaming, Delta Lake, and Unity Catalog.
  • Experience designing reliable workflow orchestration, including scheduling, dependencies, parameters, retries, notifications, and operational monitoring.
  • Experience implementing data governance and access controls with Unity Catalog, including catalogs, schemas, tables, views, external locations, storage credentials, lineage, and fine-grained permissions.
  • Experience with Terraform, Databricks Asset Bundles, or comparable Infrastructure as Code approaches, along with Git and CI/CD practices.
  • Strong experience troubleshooting and optimizing Spark workloads using tools and techniques such as Spark UI, job logs, query plans, partitioning, join optimization, and Adaptive Query Execution.
  • Strong understanding of conceptual, logical, relational, dimensional, and physical data modeling.
  • Experience delivering ETL/ELT solutions through the complete engineering lifecycle, from requirements and design through deployment and production support.
  • Demonstrated ability to balance engineering quality, delivery speed, scalability, resiliency, and cost while making pragmatic technical trade-offs.
  • Strong problem-solving skills with demonstrated ability to diagnose and resolve complex data and production issues.
  • Demonstrated technical leadership, including solution design, code reviews, engineering standards, mentoring, and team unblocking.
  • Ability to influence technical direction, facilitate alignment, and build consensus across engineering teams and stakeholders without relying on formal authority.
  • Experience working within Agile delivery models such as Scrum, Kanban, or SAFe.

Preferred Qualifications

  • Prior experience serving as a technical lead, lead engineer, or senior engineer with responsibility for technical design and engineering standards.
  • Advanced Python and/or Scala development experience.
  • Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud.
  • Experience with cloud storage technologies such as Azure Data Lake Storage Gen2, Amazon S3, OneLake, or Google Cloud Storage.
  • Experience with modern data platforms and open table technologies such as Snowflake, Apache Iceberg, Apache Hudi, or BigQuery.
  • Experience with messaging and event-streaming technologies
  • Experience with NoSQL technologies such as Cassandra or HBase.
  • Experience designing or consuming REST APIs and web services.
  • Experience developing governed data products supporting AI, Generative AI, Machine Learning, semantic models, APIs, advanced analytics, Genie Spaces, or AI agents.
  • Experience implementing enterprise-scale data governance, data quality, metadata, and lineage capabilities.
  • Experience working with insurance, Health data.
  • Practical experience using AI-assisted development tools such as GitHub Copilot, Claude, or Databricks AI-assisted development capabilities to improve engineering productivity.

What Will Put You Ahead

  • Deep experience designing, building, and optimizing production-scale Databricks Lakehouse solutions.
  • Experience building high-volume or near-real-time ingestion solutions
  • Advanced Python experience developing reusable engineering frameworks, libraries, automation, and platform capabilities.
  • Experience building governed, reusable data products for AI and Generative AI applications.
  • Demonstrated ability to simplify complex technical architectures and establish reusable engineering patterns across teams.
  • A track record of raising engineering standards while helping teams deliver incrementally and predictably.
  • Strong technical judgment and the ability to identify the right balance between speed, simplicity, scalability, reliability, governance, and cost

Teammate Benefits & Total Well-Being

We go beyond standard benefits, focusing on the total well-being of our teammates, including:

  • Health Benefits: Medical/Rx, Dental, Vision, Life Insurance, Disability Insurance
  • Financial Benefits: ESPP; 401k; Student Loan Assistance; Tuition Reimbursement
  • Mental Health & Wellness: Free Mental Health & Enhanced Advocacy Services
  • Beyond Benefits: Paid Time Off, Holidays, Preferred Partner Discounts and more.

Not reflective of all benefits. Enrollment waiting periods or eligibility criteria may apply to certain benefits. Benefit details and offerings may vary for subsidiary entities or in specific geographic locations.

Recruiting Vendor Disclosure Statement

Brown & Brown does not accept unsolicited resumes from external recruiters, recruitment vendors or employment agencies ("Recruiting Vendors"). Recruiting Vendors must have a valid written agreement and received prior written authorization from an authorized Brown & Brown representative before submitting candidates for any publicly posted role. Any unsolicited resumes submitted to Brown & Brown or its employees become the property of Brown & Brown, and no fees will be paid for such submissions. Additional information regarding this policy can be found on our careers page.

The Power To Be Yourself

As an Equal Opportunity Employer, we are committed to fostering an inclusive environment comprised of people from all backgrounds, with a variety of experiences and perspectives, guided by our Diversity, Inclusion & Belonging (DIB) motto, “The Power to Be Yourself”.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Brown & Brown's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Brown & Brown's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Brown & Brown's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.