Skip to content

38. Manage the test suite life cycle

Test suites accumulate over time, and each test suite (regression) contains a large number of runs. It is possible that a project might reach the workable limit of the ElasticSearch database – about two billion runs in a single index. When this happens, the database does not allow you to add more test suites, and functions of Foretify Manager might degrade.

To help you avoid hitting this limit, Foretify Manager provides a configurable clean-up function that marks unprotected test suites as pending deletion and then deletes them after another period of time. This clean-up happens every night.

The clean-up function is disabled by default. To enable it or to change the settings, you must use an admin account, and navigate to the Admin Settings page.

Users can protect a test suite to prevent it from being deleted by the clean-up function. However, protected test suites can still be manually deleted.

To enable, disable or modify life cycle settings:

  1. Log into Foretify Manager with an admin account.
  2. Click the Admin Settings label at the top menu.
  3. Choose Cleanup Policy from the left sidebar.
  4. Select the settings you want in the Cleanup Policy form and click Save.

The options in this form are:

  • Delete Runs Older Than specifies a time period after which test suites are deleted. The predefined time periods are Never (the default), two weeks, one month, three months and six months. This time period is counted from a test suite's Created At property.

    • All test suites older than the selected time period are deleted when the cleanup runs.
    • Among the remaining test suites, all those that are not more than one week newer than that are marked as pending for deletion.
    • If you select Custom, you can define a Custom Period by any number of days, weeks or months.

  • Notify Before Deletion specifies a time period counted back from the Delete Older Than setting during which the test suite is marked Pending Deletion. The predefined time periods are Never (the default), one day, one week and one month.

  • Always delete empty regressions deletes the test suite immediately after deleting its runs.

The saved settings are applied to any test suite created by any user, unless it is protected. Any test suite marked Pending Deletion is deleted when the specified time passes, even if the Cleanup Policy settings are subsequently changed.

To add protection to or remove protection from a test suite (regression):

  1. Log into Foretify Manager with any account.

  2. In the Protected column of the Test Suite Results tab, click the icon to change the status. If the Protected column is not displayed, click the Column Selection icon in the table header and select it.