Skip to content

Open nowPosted 3 days ago

Senior Analyst, AI Performance & Reliability

WestJet Group22 open roles

Where
22 Aerial Pl NE, Calgary, AB T2E 3J1, Canada
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSenior Analyst, AI Performance & ReliabilityWestJet Group · 22 Aerial Pl NE, Calgary, AB T2E 3J1, Canada
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on WestJet Group's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

14.3% of postings close within 7 days. Measured by our own scanner across the market. WestJet Group postings stay open a median of 15 days.

Share of postings closed within
  1. 2.2%1 day
  2. 4.7%3 days
  3. 14.3%7 days
  4. 23.1%14 days
  5. 39.5%30 days
  6. 59.2%60 days
This job: posted 3 days ago

WestJet Group median: 15 days open

The posting

Position Overview: The Senior Analyst, AI Performance & Reliability is accountable for the health, performance and reliability of AI and machine learning solutions in production. The role monitors AI services and model behaviour, identifies emerging issues, coordinates incident response, and drives improvements that keep solutions stable, available, cost-effective and performing as expected. The role provides ongoing visibility into service availability, latency, errors, usage, cost, data quality and output quality, including model drift and unexpected or inappropriate results. Working closely with AI / ML Developers, Data Scientists, platform teams, business owners, security and governance teams, the role helps ensure production AI and ML solutions can be trusted to operate consistently and recover effectively when issues occur. Key Deliverables:

Accountable for keeping AI and ML solutions reliable, available and performing as expected through effective monitoring, incident management, troubleshooting, service recovery and continuous improvement. Monitor AI and ML solutions in production, including availability, latency, errors, throughput, usage, cost, data quality and output quality. Build and maintain dashboards, alerts, health checks and reusable monitoring patterns that provide timely visibility into solution health. Detect model drift, data changes, degraded performance, unexpected outputs, harmful or inappropriate responses and other signs of service deterioration. Work with business and technical owners to define reliability targets, service expectations, operational thresholds and escalation triggers. Produce regular operational reporting and communicate material trends, risks and service issues to appropriate stakeholders. Lead the investigation, triage and coordination of production incidents affecting AI and ML solutions. Assess business and operational impact, establish incident priority, and coordinate response activities across technical and business teams. Troubleshoot issues across applications, APIs, models, data pipelines, platforms and infrastructure to identify likely causes and required actions. Coordinate with AI / ML Solutions Developers and platform teams when rollbacks, configuration changes, model replacements, fixes or redeployments are required. Validate service recovery and confirm that the solution, monitoring controls and outputs are operating as expected. Conduct post-incident reviews, document root causes and lessons learned, and track corrective and preventive actions to completion. Maintain support procedures, runbooks, escalation paths, contact lists and recovery plans. Identify and address risks that could affect solution reliability, availability, performance, resilience or recovery. Improve monitoring coverage, alert quality, recovery practices, automation and operational support processes. Assess production readiness and confirm that appropriate monitoring, support documentation, escalation processes and recovery procedures are in place before release. Support capacity, performance and cost optimization by identifying constraints, inefficient usage patterns and emerging demand. Partner with AI / ML Solutions Developers, Data Scientists and platform teams to prevent repeat incidents and improve solution supportability. Contribute operational requirements and lessons learned to solution design, testing and lifecycle decisions. Monitor model and AI output performance against defined technical, quality and business acceptance measures. Identify changes in source data, knowledge sources, user behaviour or business conditions that may affect solution performance. Analyze feedback, exceptions and performance trends to determine when investigation, correction, tuning or retraining may be required. Escalate identified model or output concerns to the accountable solution, model, business and governance owners. Maintain traceable records of identified issues, thresholds, findings and follow-up actions. Monitor production safeguards and escalate material reliability, privacy, security, responsible AI, model risk or compliance concerns. Support operational evidence, reporting and documentation required for governance reviews, audits and oversight. Confirm that access, logging, monitoring and incident-management practices follow approved enterprise requirements. Help define and improve reliability standards, service-health measures, operational controls and reusable monitoring practices. Promote consistent incident, problem-management and continuous-improvement practices across AI teams. Use monitoring, incident, usage, cost and feedback data to identify opportunities to improve reliability, performance and supportability. Identify recurring issues and coordinate longer-term corrective actions with solution and platform owners. Share operational insights, lessons learned and emerging risks with technical teams, business owners and leadership. Contribute to operational reviews, reliability planning, knowledge sharing and the ongoing maturity of AI / ML operations. Communicate technical issues and service impacts clearly to both technical and non-technical stakeholders.

Experience and Qualifications:

Bachelor's degree in Computer Science, Engineering, Data Science, Information Systems or a related field, or equivalent practical experience. Relevant certifications in cloud platforms, observability, site reliability, IT service management, AI or machine learning are considered an asset. 4+ years experience supporting production systems, AI solutions, ML platforms, data products or cloud-based services. Experience with monitoring, observability, logging, alerting and incident-management tools and practices. Experience troubleshooting applications, APIs, data pipelines, infrastructure or distributed cloud services. Experience investigating production incidents, coordinating recovery and contributing to root-cause analysis and preventive actions. Experience using operational data and service metrics to identify trends, risks and improvement opportunities. Experience working with multidisciplinary technology and business teams in a production support environment. Understanding of model monitoring, drift detection, data quality, AI output evaluation and changing production conditions. Understanding of reliability, availability, performance, resilience, capacity, recovery and service-management practices. Knowledge of service-level indicators, service expectations, operational thresholds and effective alert design. Ability to analyze logs, metrics, traces, model results and other technical evidence to diagnose complex issues. Familiarity with cloud platforms, APIs, containers, data pipelines and AI / ML solution architectures. Familiarity with security, privacy, responsible AI, model risk, governance and audit requirements. Strong analytical, problem-solving, prioritization and decision-making skills. Strong communication, coordination and documentation skills, particularly during high-priority incidents. Ability to work calmly and effectively across a matrixed environment when service issues require rapid coordination.

What Success Looks Like

Production issues are detected early, assessed accurately and resolved quickly. AI and ML solutions consistently meet defined reliability, availability, performance and output-quality expectations. Model drift, data-quality issues, unexpected outputs and service degradation are identified before they create significant business impact. Monitoring provides clear, actionable visibility into solution health, usage, cost and emerging risk. Incident response, escalation and recovery processes are understood, documented and effective. Root causes are addressed and repeat incidents decrease over time. Operational risks and material privacy, security, responsible AI or compliance concerns are escalated promptly. Business users and solution owners can rely on AI and ML services to operate consistently and effectively. Operational insights lead to measurable improvements in reliability, resilience, performance and supportability.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against WestJet Group's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on WestJet Group's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    WestJet Group's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.