Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 19 hours ago

Thesis: Can AI Agents Replace the Tester? Comparing LLM Browser Agents and Scripted End-to-End Tests

Knightec Group Compliance and Management AB159 open roles

Where
Sundsvall, Sweden
Work mode
On site
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowThesis: Can AI Agents Replace the Tester? Comparing LLM Browser Agents and Scripted End-to-End TestsKnightec Group Compliance and Management AB · Sundsvall, Sweden

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Knightec Group Compliance and Management AB's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

9.8% of postings close within 7 days. Measured by our own scanner across the market. Knightec Group Compliance and Management AB postings stay open a median of 5 days.

Share of postings closed within
  1. 1.9%1 day
  2. 3.9%3 days
  3. 9.8%7 days
  4. 15.6%14 days
  5. 33.9%30 days
This job: posted 19 hours ago

Knightec Group Compliance and Management AB median: 5 days open

The posting

High Level Description End-to-end (E2E) tests verify that a web application works the way a user experiences it. They are valuable but expensive: scripted tests (e.g., Playwright, Cypress) take time to write, break when the user interface changes, and only find the bugs someone thought of in advance. A new alternative is LLM-based agents that control a real browser. They read the screen, click, type and judge whether the application behaves correctly, much like a human exploratory tester. This thesis will compare AI-driven exploratory testing with traditional scripted E2E tests on open-source web applications with deliberately planted bugs, to find out which approach finds more bugs, how reliable, and at what cost.

Cost is a central question: AI agents are cheap to set up but every test run consumes paid model usage, while scripted tests are expensive to write and maintain but cheap to run.

Project Description The work will involve setting up one or two open-source web applications as test subjects, preferably from a regulated domain where workflows, user roles and data integrity matter.

To measure how well each testing approach finds bugs, the bugs must be known in advance. A catalogue of 30–50 realistic faults will therefore be built and injected into the applications in a controlled, repeatable way. The faults will cover:

  1. Functional logic – e.g., wrong calculations or incorrect state changes.
  2. Input validation – invalid data is accepted, or valid data is rejected.
  3. Authorization – users can see or change data they should not have access to.
  4. Data integrity – data is silently lost, or audit trail entries are missing.
  5. UI & usability – hidden controls, misleading labels or unreachable steps.

The following testing approaches will then be compared:

  1. Scripted baseline – A scripted end-to-end test suite, written within a fixed time budget.
  2. Free exploration – The agent only gets the URL and login credentials.
  3. Persona-driven exploration – The agent acts as a role (e.g. technician or administrator) with goals to reach.
  4. Spec-guided exploration – The agent also gets user documentation or requirements, so it knows what should happen.

Agent-authored scripts – The agent explores the application and then writes scripted regression tests from what it found.

The AI agents will be built by connecting large language models (LLMs) to a real web browser, so they can navigate, click, type and read the screen like a human tester. At least two different LLMs will be compared, including both a large, more capable model and a smaller, cheaper one, to see how model choice affects bug detection and cost.

Cost will be tracked for every approach throughout the work. For the agents this includes model usage (tokens and API cost), run time and the number of repeated runs needed for reliable results. For scripted tests it includes the time to write the tests, the time to update them after UI changes, and the compute time to run them. Human time spent reviewing agent reports and sorting out false alarms will also be counted.

Who are we looking for?

  • Bachelor/Master of Science in Computer Science, Software Engineering, or related fields.
  • Graduation in June 2027
  • Fluency in Swedish, both written and spoken
  • Fluency in English, both written and spoken

Purpose In this thesis investigate these questions:

  • Bug detection – How many planted bugs does each approach find, per fault category? Are some categories systematically missed?
  • False alarms – How often do agents report issues that are not real bugs, and how much human effort does it take to sort them out?
  • Stability & reproducibility – How much do results vary across repeated runs, and can a reported bug be reliably reproduced from the agent's report?
  • Resilience to change – After realistic UI changes (renamed buttons, moved menus, new layouts), which approaches still work, and what does maintenance cost?
  • Cost per run & per bug – What does a single test run cost for each approach, and what is the cost per bug found? How much can be saved with smaller models, shorter sessions or limiting exploration, and how much bug detection is lost?
  • Total cost over time – Compare the total cost of each approach over a realistic period, including setup, running, maintenance and human review. When does each approach break even, and how does the cost change if tests run on every code change rather than nightly or before each release? An Exciting Journey with Knightec Group Semcon and Knightec have joined forces as Knightec Group. Together, we are Northern Europe’s leading strategic partner in product and digital service development. With a unique combination of cross-functional expertise and a holistic business understanding, we help our clients realize their strategies – from idea to complete solution.

Practical Information This is a thesis position, located at our office in Sundsvall. Start date January or March 2027.

Please submit your application as soon as possible, but no later than 2026-11-30. If you have any questions, you are welcome to contact [email protected]. Note that due to GDPR, we only accept applications through our careers page.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Knightec Group Compliance and Management AB's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Knightec Group Compliance and Management AB's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Knightec Group Compliance and Management AB's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.