Skip to content
OttoTester docs

Quickstart

OttoTester tests web apps with AI agents — they explore your app, write the tests, and run them. This walkthrough takes you from a fresh account to a first passing test. It’s about ten minutes, most of which is the agents working.

1. Get into a workspace

Section titled “1. Get into a workspace”

Work in OttoTester happens inside a workspace. If a teammate invited you, you already have one — open it. If not, create one: see Set up a workspace.

2. Add your application

Section titled “2. Add your application”

On the Apps page, click New App. Step 1 names the application, the product you want to test. Step 2 adds its first variant: the environment to test against, with its URL. Create & Scan saves both and scans the URL.

That’s the minimum OttoTester needs: something to point at.

3. Set up sign-in (if your app needs it)

Section titled “3. Set up sign-in (if your app needs it)”

If the part of your app you want to test sits behind a login, set up a fixture so the agents can sign in. You provide credentials once; OttoTester handles the rest. See Set up authentication.

If the pages you’re testing are public, skip this step.

4. Run the agents

Section titled “4. Run the agents”

Open the Tests page and press New Test on the Active tab. If you already have proposed tests, you can instead select some on the Proposed tab and press Create tests. Either way, the run’s settings open first, from a Test Authoring Template; the default template is fine for a first run. With nothing selected, describe what to test in the Agent Prompt, for example “test the checkout flow”.

Launch it. Now the agents work:

  • the planner explores the app and decides what to test,
  • the generator writes a Playwright script for each test,
  • the executor runs them.

5. Read the result

Section titled “5. Read the result”

When the run finishes, open its report. You’ll see each test and whether it passed. Open a test to see its steps; open a failed one to see exactly where it broke. See Read a run report.

That’s a working test suite — generated, run, and reported, without writing a line of code.

Where to go next

Section titled “Where to go next”