LogoLogo
  • About SimplifyQA
  • Get Started with SimplifyQA
    • Agile & Non-Agile Framework
    • OS Support
    • SimplifyQA Hosting
      • On-premise Installation Guide
        • Pre-requisites
        • Installation Guide
      • Support and Resources
      • Training and Onboarding
    • Explore SimplifyQA for your Application Lifecycle Management
  • SimplifyQA Installation & Setup
    • Setup QAWizard
    • Register QAWizard
    • Register your Machine
    • Setup Android Device
      • How to enable settings in android device?
      • How to register android device?
      • Setup emulators on Android Studio for automation in SimplifyQA
    • Setup iOS Device
      • How to setup and register iOS device?
  • Get to know your Workspace
    • Blueprint of SimplifyQA
    • Key Terminologies
    • Search/Global Search
      • How to use global search?
      • How to use advance search?
      • How to use column sort?
      • How to use column filters?
      • Add or remove columns
    • Rich Text Editor
    • Import & Export
      • Learn how to import/export Test Cases
      • Learn how to import/export Test Data
    • Add Attachments
    • Add Linkages
    • Add Comments
    • Manage Cards in board view
    • Configure Watchlist
    • Track Edit History
    • Hierarchy Tree
  • Admin Controls & Configurations
    • Manage Projects & Users
      • Introduction to Projects in SimplifyQA
      • Create Project and Invite Users
      • Project Settings
        • Create and Manage Custom Fields
        • Manage Roles and Privileges
        • Configure Auto-logging of Defects
      • Grant Admin Privilege to User
      • Invite/Add Users to Team
      • User Directory and Access Control
      • Configure Page Layout
    • Configure your clients
    • Password settings
  • Release & Sprints
    • Introduction to Releases
    • Create & Manage Release & Sprint
    • Start & Close a Sprint
  • Create and Manage your Requirements
    • Introduction to Requirement Management
    • Create & Manage Epic
    • Create & Manage Features
    • Create & Manage User Stories
      • Generate using AI Genius
  • Introduction to Test Management in SimplifyQA
    • Create a Manual Test Case in SimplifyQA
    • Create an Automation Test Case in SimplifyQA
    • Learn API Testing in SimplifyQA
      • Create an API Test Case in SimplifyQA
      • Quick Test the API
      • Validating API Responses
      • Understanding API Parameterisation
      • Save API Response Data
      • Achieve Data flow for E2E Testing
    • Create a Database Test Case in SimplifyQA
    • Create Hybrid Test Case in SimplifyQA
    • Leverage Re-usability in your Tests
    • Organise your Test Cases
    • Linking a Test Case to User Story
    • Linking a Test Case to Defect
    • Version Control your Test Case
    • Create a Copy of your Test Case
    • Copy Test Case to different Project
    • Conditional Statements
      • Decision Making Statement
      • Looping Statement
      • BREAK & CONTINUE Statement
    • Supported Actions
    • Utilising Mobile Inspector in SimplifyQA
  • Introduction to Script-less Recording of Test Case
    • Record a Web Test Case in SimplifyQA
    • Record an Android Test Case in SimplifyQA
    • Record an iOS Test Case in SimplifyQA
    • Record Functions in SimplifyQA
    • Understand Object Recognition Mechanism & Self Healing in SimplifyQA
    • Low Level Recording
  • Test Data Management
    • Generate dynamic data using Formulas to Optimise Test Data
    • Import and Export Test Data Sets
  • Introduction to Object Repository
    • Capture Objects for your Tests
    • Organise your Test Objects
    • Parameterise your Test Object Properties
  • Introduction to Parameters
    • Various Types of Parameters
    • Create and Utilise Parameters in your Test Case
    • Understanding Runtime Parameters
  • Code Editor
    • Using Git Commands
    • Configuring Privileges for Sync Actions
    • How to Sync Actions using Code Editor?
    • How to use AI to write code?
  • Introduction to Test Execution in SimplifyQA
    • Create an Execution Plan
    • Create a Suite
      • Execute your Test Suite and View Suite Reports
      • Execute your Suite on Cloud (Serial/Parallel)
    • Schedule your Execution
    • Create Pipelines
  • Defect Management
  • Marketplace
    • Integration with Project Management Tools
      • Integrating SimplifyQA with Jira
        • Configure Web-hooks
        • SimplifyQA Setup for Integration
          • Setup your Account for Jira Integration
          • Configuration in SimplifyQA Admin
          • Steps to Generate a Jira API Token
          • Steps to create SimplifyQA token
          • Steps to get Jira Account ID
          • Synchronisation Functionality Between SimplifyQA and Jira
          • Analyse Logs for Data Synchronisation
        • Mapping Fields for Issue Types
        • Viewing SimplifyQA Test Cases in Jira
    • Integrating with CI/CD Tools
      • Gitlab
      • Azure Devops
      • Concourse
    • Integrating with Cloud Platforms
      • VM Based
  • Legal Documents
    • End-User License Agreement
Powered by GitBook
On this page
  • Suite Execution Settings
  • Viewing Execution Reports
  • Navigating Back to Suite from Reports
  1. Introduction to Test Execution in SimplifyQA
  2. Create a Suite

Execute your Test Suite and View Suite Reports

This section covers how to configure and execute a test suite—a group of related test cases bundled together for streamlined execution.

PreviousCreate a SuiteNextExecute your Suite on Cloud (Serial/Parallel)

Last updated 15 days ago

To execute a test suite:

  1. Select the test cases you want to execute by checking the corresponding checkboxes.

  1. Choose the required Execution Platform:

  • If executing Mobile Test Cases, select the appropriate Device (iOS/Android) and ensure the test environment is set up.

  • If executing Web Test Cases, select the preferred Browser

  1. Select the Execution Type Choose how the test suite should be executed:

    • Local – Runs the suite on your local machine using your configured drivers and settings.

    • Remote – Executes the suite on a remote server or grid that you’ve integrated with SimplifyQA.

    • Cloud – Utilisnes third-party cloud platforms (like BrowserStack or Sauce Labs) for execution across different environments and devices.

  1. Click Run to initiate execution. A pop up will open and select the desired release and sprint and click execute.

During execution, test progress and logs can be monitored in real-time.

Suite Execution Settings

  • Click on the Settings button to configure additional execution options.

Note: Suite Settings option will only be available for automation test suites.

  • Auto Re-execution: Defines how many times a failed test case should be retried automatically. Helps reduce the impact of flaky or environment-sensitive test failures. You can configure the number of retry attempts based on your needs.

    • At the End of the Suite: Re-executes all failed test cases after the entire test suite has finished running. Ensures full test coverage before revisiting any failures.

    • At the End of Each Test Case: Immediately retries a failed test case after execution. Continues retrying until the test passes or reaches the retry limit, making it ideal for catching intermittent or transient issues.

  • Auto Logging of Defects: Automatically logs defects for any failed test case when this feature is enabled in the Admin Module. Ensures consistent issue tracking and accelerates feedback to the development team.

  • New Browser Session: Allows you to choose whether each test case runs in a fresh browser session or reuses a single session across test cases. Use new sessions for better test isolation; reuse sessions to speed up execution.

  • Terminate on Failure: Stops the entire suite execution immediately if a test case fails. Useful for sanity or critical path testing where early failure detection is a priority.

Make any required changes and click 'Save' to apply the settings.

Viewing Execution Reports

Once execution is complete:

  1. Click on the Reports icon to view detailed execution results.

  1. Reports include:

  • Execution time: Total time taken for execution.

  • Executor details: Information about the user who executed the suite.

  • Technology used: The automation framework or technology used.

  • Execution status (Pass/Fail): A summary of passed and failed test cases and more details.

  1. Click the Arrow next to each test case to view individual test execution reports.

  1. View Execution History to track previous suite executions and compare results.

  1. Re-execute test cases directly from the Reports page:

  • Select failed test cases and click Run.

  • Modify test data if needed before re-execution.

  1. Click Excel Export to download execution details for reporting and analysis.

Navigating Back to Suite from Reports

  • Click Go to Suite from the Reports page to return to the suite overview, allowing for quick iteration and re-execution of test cases.

Manual Suite:

  • Suite Execution Settings are not available in manual suites.

  • You can only perform Local Execution—integration with remote servers or cloud platforms is not supported for manual test execution.

Automation Suite:

  • Full access to Suite Execution Settings, allowing configuration of retry logic, browser session handling, and more.

  • Supports Local, Remote, and Cloud Execution, offering greater flexibility and scalability for automated test scenarios.