Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 162 days ago

Senior Quality Engineer - AI

StarRez10 open roles

Where
Australia
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSenior Quality Engineer - AIStarRez · Australia

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on StarRez's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.3% of postings close within 7 days. Measured by our own scanner across the market. StarRez postings stay open a median of 36 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.3%7 days
  4. 19.7%14 days
  5. 35.6%30 days
  6. 58.0%60 days
This job: posted 162 days ago

StarRez median: 36 days open

The posting

About StarRez

StarRez is the global leader in student housing software, providing innovative solutions for on and off-campus housing management, resident wellness and experience, and revenue generation. Trusted by 1,400+ clients across 25+ countries, StarRez supports more than 4 million beds annually with its user-friendly, all-in-one platform, delivering seamless experiences for students and administrators. With offices in the United States, Australia, the UK, and India, StarRez blends the robust capabilities of a global organization with the personalized care and service of a trusted partner.

The Role:

We are looking for a Senior Quality Engineer - AI to help shape how StarRez evaluates, validates, and improves AI-powered product experiences.

You will play a pivotal role in elevating our quality practices for AI-powered product experiences and tooling. You will be a product expert within our engineering organization, deeply understanding workflows and customer outcomes. This role will balance hands-on individual contributor responsibilities with leading, influencing, and coaching your peers.

You’re someone who is passionate about seeing systems holistically and is eager to drive the highest standards of accuracy, safety, usefulness, and reliability. You will help define what "good" AI output means for StarRez, build repeatable evaluation systems, coach reviewers and subject matter experts, and turn subjective feedback into measurable product improvement.

You will work at the intersection of AI engineering, product, and domain knowledge — partnering with engineers, product managers, and SMEs to raise the bar on how StarRez evaluates, monitors, and improves AI tools.

Key Responsibilities:

  • Lead or contributed to end-to-end AI quality and evaluation strategy for product experiences involving LLMs, RAG, prompts, tool-use, or agent workflows.
  • Provided quality-focused input during ticket grooming, discovery, and feature discussions, with clear guidance on testability, observability, scalability, reliability, product resilience, customer usability, and operational readiness.
  • Championed shift-left quality practices by influencing or mentoring developers and cross-functional partners on evaluation-driven development, clear acceptance criteria, early validation, and fast feedback loops.
  • Coached or calibrated human reviewers, subject matter experts, or product teams by running calibration sessions, reviewing patterns, improving rubric clarity, and converting domain knowledge into reliable evaluation criteria.
  • Contributed to the evolution of development or quality pipelines, including automated and human evaluation workflows, regression monitoring after model upgrades, prompt changes, RAG updates, or agent workflow changes.
  • Define practical AI quality standards, rubrics, and evaluation criteria that help teams assess AI outputs consistently across StarRez product workflows.
  • Partner with engineering and product teams to identify AI quality risks early, including risks related to grounding, hallucination, tool-use behaviour, retrieval quality, customer impact, and safe escalation.
  • Build or support repeatable evaluation approaches that help teams compare prompt, model, RAG, data, or workflow changes before release.
  • Translate AI failure patterns into actionable product and engineering improvements, such as prompt changes, retrieval improvements, source-data fixes, tool safeguards, UX changes, or escalation-flow updates.
  • Use metrics, reviewer feedback, quality trends, and operational signals to support release readiness and ongoing product improvement.

Required Experience:

  • Quality Assurance or Quality Engineering experience in a SaaS B2B or B2B2C company.
  • Proven track record as a senior individual contributor with a strong quality mindset and the ability to influence technical and product direction.
  • Excellent technical communication and collaboration skills, with the ability to guide engineering peers, product partners, and non-technical stakeholders through clear quality insights.
  • Data-driven approach to quality management, with experience using metrics, dashboards, trend analysis, reviewer agreement, or operational reporting to guide decisions.
  • Hands-on technical comfort with test automation, evaluation tooling, observability, or scripting, and the ability to partner with engineers to build pragmatic evaluation pipelines.

Highly regarded:

  • Experience with LLM evaluation pipelines, automated eval tooling, LLM judges, or agent observability platforms.
  • Background in traditional QA or quality engineering, particularly in environments transitioning to AI-augmented workflows.
  • Familiarity with safety, bias, and compliance evaluation for AI systems.
  • Experience in SaaS or enterprise software environments, ideally with exposure to student housing, property management, or similar domainspecific AI products.
  • Exposure to production monitoring of AI systems, including drift detection and post-release quality tracking.

Reasons to join our Team:

  • You will be part of a vibrant and supportive culture, with weekly team lunches.
  • We are a flexible and hybrid workplace.
  • You will have access to professional development opportunities.
  • Be part of a global team, participate in monthly global meetings and partner with team members in different countries.
  • Z-Factor: Our most celebrated value, you will work with a team of caring, energetic, high-performing, and passionate people who have fun supporting our vision, innovation & continuous improvement.

We are proud of our diverse workforce and are dedicated to creating a safe and welcoming environment for all employees. People from various ethnicities, ages, genders, and abilities are encouraged to apply.

Please note, StarRez requires all candidates to have full work rights in Australia.

Notice to external Recruiters and Recruitment Agencies:

StarRez will not accept unsolicited resumes from recruitment agencies, headhunters, or any other third parties for this role through this website or directly to any employee. StarRez and any of our subsidiaries will not pay fees to any third-party agency or company. In addition, we ask that you do not reach out to any employee with regards to this position, or any other positions, now, or in the future.

StarRez is an equal opportunity employer.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against StarRez's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on StarRez's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    StarRez's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.