Write Tests
Create step flows and preview your test in real-time
Create A New Test
Create a new test through the dashboard by filling out basic information:
- Test Name - the name of your test
- Test URL - the web page you want the test to start from
- Test Description - a description of what the test does (note that this is not the prompt of the test)
- Collection - the Collection you want to assign the test to
Click ‘Create Test’ which will set up a Preview Editor where you can write and preview your test.
Write Your Test in the Preview Editor
Tests are composed of a flow of steps and are written in the Preview Editor. Here, you can also preview the test live to make sure the agent does what you intend.
Each step is an instruction, written in natural language, telling the agent what to do. Use our Prompting Tips to understand what steps can look like.
You can add steps to the flow as follows:
- Type the description of the test step - this is the instruction the agent will follow, e.g. “Click the login button”
- Select the type of step you want this to be: Action”, “Verify”, or “Extract” (see Step Types)
- Click ‘Add’ to include this as a step in the test
- You can remove steps and reorder them by dragging.
Preview Your Test
You can ‘Preview’ the test to see how it will run. The preview livestreams the agent’s actions in real time so you can see it operate and make sure it does what you intended for each step. You can also see the agent’s reasoning in the console, along with the output of each step and the agent’s reasoning for passing/failing the test.
Once you are happy with your test flow and all outputs are as expected, you can save the test to run it at any time.
Save Your Test
Tests that have steps are saved automatically, or you can click ‘Save & Exit’ to return to the Library.
Duplicating Tests
You can duplicate any test from the Library, and you can edit the copy. Test duplication is useful for creating variations of the same flow.