Test Manager user guide

DELIVERY:

Last updated Sep 3, 2025

Executing automated tests

You can execute all test sets using the Execute > Execute Automated option from the Overview tab of a test set. This option invokes Orchestrator for test cases that are linked to Test Manager. To execute test sets linked from Orchestrator, make sure you create your test sets in Orchestrator.

You can also execute automated tests if the test set includes test cases linked from Studio. For more information, check Executing Tests.

Prerequisites

To execute automated tests while the Allow legacy execution context setting is disabled, you need the following permissions in Orchestrator:

At the tenant level: Folders.View and Users.View.
At the folder level, where the test automation package was published: TestSets.Create and TestSetExecutions.Create.

Conditions

Important: To use the Execute Automated option, you need at least one automated test case in a test set.

Automated test executions have a default timeout of four days that you cannot change. Any automated test execution that exceeds four days is marked as Cancelled.
Test execution for test sets linked from Orchestrator includes only the test cases published to the Orchestrator Tenant Process Feed in the latest package version. To execute new test cases, publish a new package version in Orchestrator, and link the test set to Test Manager.
The following information is applicable only if you are using the legacy execution context in Test Manager: If your Test Manager test set includes test cases from multiple Studio projects, then the project that has the highest number of test cases is considered for execution. As a result, only the test cases from this project will be executed. Additionally, Test Manager will display a warning stating that multiple packages have been selected, and only some of them will be executed.
You can execute test sets including test cases from multiple Studio projects, only if you have a test set linked from Orchestrator.
If your test set includes duplicate test cases in multiple Studio projects, the sorting is done by the project name in descending order. Only the test cases from the project that is placed first in the list will be executed.

Execute Automated Test Sets

Open your project in Test Manager and then navigate to Test Sets.
Select a test set and click the vertical ellipsis.
Select Execute Automated.
For more information on test results, see Analyzing Test Results.
Note:
- Test cases that cannot be executed are skipped during execution through Orchestrator.
- Test cases that are not executed generate test case logs with no result.

Alternatively, you can open your test set, click Execute and select Automated from the dropdown.

Live streaming and remote controlling

You can view the live stream of a robot running a test execution, and, if needed, take control of the execution using your own mouse and keyboard, without pausing the test. This helps you troubleshoot and debug more efficiently, reducing manual interventions and time to resolution.

These capabilities are disabled by default and must be enabled either at the test set or test execution level.

Note: Live streaming is not supported for test executions that:

Have Enforce execution order enabled
Use test cases with test data, such as data provided via Test Data Queue or Data Fabric.

Prerequisites

To use the live streaming and remote controlling capabilities, follow these steps:

Ensure that your Test Manager role has the following permissions:
- TestSets.Edit: To enable live streaming and remote controlling,
- View live stream of automated executions: To watch the test execution.
- Remotely control live stream of automated executions: To control the test execution remotely.
Note: By default, the Test Manager project role has the View live stream of automated executions permission. But to remotely control the live stream, a Test Manager Administrator must manually assign this permission to users via a custom role.
Enable the live stream or the remote control capability at the test set level, for the desired test set:
1. Open the test set or test execution.
  - For test sets: Go to the Configuration tab.
  - For test executions: Go to the Settings tab,
2. Select the Enable Live Streaming toggle to enable the capture of a live stream of a test execution.
3. Alternatively, if you want to be able to remotely control the running test execution, under Allow Remote Control select Enable.