The posting
About Patronus AI
Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. We are on a mission to simulate all of the world’s intelligence.
We are the team behind some of the earliest and most influential research in AI evaluation like FinanceBench, Lynx, SimpleSafetyTests, CopyrightCatcher, Humanity’s Last Exam, and more. We are formerly AI researchers and engineers from companies like Meta AI, Amazon AGI, and Google. Our customers include foundation model labs and Fortune 500 enterprises like Adobe. We are backed by top-tier investors like Lightspeed Venture Partners, Notable Capital, Stanford University, Noam Brown, Gokul Rajaram, and more.
At a glance
- Engagement: Independent contractor, fully remote, asynchronous
- Pay: $50 to $150 per hour. Some projects pay per task instead: you are paid when the full task is submitted, with a bonus for each accepted task. Strong performers move up within that range or onto productivity-based pay. The trial task is paid.
- Commitment: 10 or more hours per week
- Start: Rolling
- Location: Remote
The role
You'll work with our research team on two things. The first is helping us understand how work in your area is actually done. The second is designing realistic sales tasks that a qualified professional could solve with the right knowledge and tools, and that today's AI models get wrong.
Each task starts from a scenario we provide. You create the working documents someone in your role would handle, write the request, solve it yourself and define how the answer is graded. Your work becomes evaluation and training data for frontier models.
You don't need an AI background. You do need to be the kind of sales professional who notices the deal marked Commit that has no champion and no signature date.
Areas we're hiring for
Each area is defined by the customer and the stage you work, so you should fit exactly one. If you work across two, apply under the one where you spend most of your time.
- New business sales. Account executives who take a qualified opportunity from discovery to signature. They build multi-threaded deal plans, write proposals and business cases, secure approvals, negotiate and close. Selling to an existing customer belongs to the next area. Typical titles: Account Executive, Enterprise Account Executive, Senior Account Executive, Regional Sales Manager with a quota, Sales Director.
- Account management, renewals and expansion. Account managers and customer success managers who own existing customers. They run business reviews, forecast and close renewals, price true-ups and expansions, and escalate churn risk. Typical titles: Account Manager, Strategic Account Manager, Customer Success Manager, Renewals Manager, Client Partner.
- Revenue operations and forecasting. Revenue and sales operations analysts who run the system around the sellers, across every deal at once. They own pipeline hygiene, forecast rollups, stage exit criteria, territory and quota plans, lead routing and commission calculation. Typical titles: Revenue Operations Analyst or Manager, Sales Operations Analyst, Sales Compensation Analyst, Forecasting Analyst, Territory Planning Manager.
- Pricing and deal desk. Deal desk and pricing analysts who decide one deal at a time. They approve discounts and non-standard terms, configure quotes and order forms, model deal economics and hand the closed deal to billing. Typical titles: Deal Desk Analyst or Manager, Pricing Analyst, Pricing Manager, Quote-to-Cash Specialist, Commercial Operations Analyst.
What you'll do
- Build realistic evidence files from a provided scenario, such as CRM exports, pipeline and forecast reports, prospect and customer email threads, proposals and order forms, renewal schedules, pricing approvals and commission statements.
- Write task requests that state the deliverable and say how uncertainty and justified assumptions should be handled.
- Solve each task end to end and document a reference solution with the reasoning behind every step.
- Write scoring criteria precise enough that two independent graders reach the same verdict, including acceptable alternative answers and the limits of what the solver is authorized to offer or approve.
- Check your own and your peers' tasks for accuracy and ambiguity.
- Work in reviewer feedback within agreed turnaround times, and flag guideline gaps or edge cases you run into.
- Explain to our research team how work in your area is actually done: the steps, the documents, who does what, and where things go wrong.
- Review the scenarios and documents our team builds from that research, and flag anything a practitioner would find unrealistic.
Who we're looking for
Required
- 3+ years of hands-on experience in at least one of the areas above, as an account executive, account manager or customer success manager, or a revenue operations, sales operations, deal desk or pricing analyst or manager. You carried the number or ran the process yourself; managing people who did is not enough.
- Working command of the methods, rules and systems in your area. Examples: a qualification framework such as MEDDICC or SPICED, forecast categories and stage exit criteria, renewal and expansion playbooks, discount approval matrices and non-standard terms, or commission plan mechanics and territory rules.
- Strong spreadsheet skills and the habit of reconciling pipeline, quota and commission figures to their source.
- Clear, precise writing in professional English.
- Ability to work independently and asynchronously against deadlines.
Nice to have
- Prior experience writing or reviewing AI evaluation tasks, exam questions, case studies or training material.
- Familiarity with how AI models fail.
Our standards
- All tasks, documents and solutions are human-authored. LLM-generated content is not permitted.
- Tasks and solutions must be original. Nothing may be copied from published or easily searchable sources.
- Never use real customer, prospect, employer or personal data, or anything covered by an NDA or confidentiality obligation. All companies, people and scenarios are fictional.
- Quality is judged on accuracy, rubric validity, difficulty and reviewer agreement, not volume.
How hiring works
- Short AI interview and resume review
- One paid trial task, scored against a fixed quality checklist
- Onboarding and your first project
Patronus AI is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.
By clicking ‘Apply’, you agree to both of the following:
1) Greenhouse's Terms of Service and Privacy Policy
2) Patronus AI, Inc. Privacy Policy.
