Automated vs Manual Execution

Automated tests are system-driven tests. 
Manual tests are user-driven tests and both can exist in the same test run

Execution is handled independently based on the test type

TestFirst supports both automated and manual test execution within the same test run.

Each type follows a different execution path and requires the appropriate permissions.

Automated Tests

Automated tests are executed by the system using test runners.

How They Run

• Triggered via:

  • Run Automatically from Test Runs (requires permission: Test Run → Run Automated Tests)

• Added to the Automated Test Queue

• Executed on:

  • Cloud runner

  • Or self-hosted runner

Execution Behaviour

• Runs without user interaction

• Follows predefined automation steps

• Results are captured automatically

• Includes:

  • Execution logs

  • Debug logs

  • Screenshots (on failure)

---

Manual Tests

Manual tests are executed by testers step by step.

How They Run

• Executed from:

  • Right-click on Test in Test Run Results View Run with TEM (requires permission: Test Plan Management → Test → Execute)

• Opened in the Manual Testing App

Execution Behavior

• Tester performs each step manually

• Marks step status:

  • Pass / Fail

• Can:

  • Add step comments/ test comments

  • Attach screenshots, attachments, recordings (requires permission: Test Execution Module → Manage (Screenshot, Attachment, Recording)

  • Log defects during execution

Mixed Test Runs

A single test run can include both automated and manual tests.

How They Are Handled

• Run Automatically:

  • Executes only automated tests

  • Manual tests are skipped

• Manual execution:

  • Performed separately by testers