Sorting and filtering

The grouping options in Allure Report 3 and the Behaviors, Suites, Packages, and Categories tabs in Allure 2 (see Improving navigation in your test report) provide various ways to sort and filter the list of tests.

Sort tests

• In Allure 3 use the Sort by: dropdown to select sort criteria and direction.
• In Allure 2 click on a label in the header to change how the tests are sorted. Click on an active label again to reverse the sorting order.

This affects both the sorting of groups (categories, suites, etc.) and the sorting of tests within the same group.

The possible sorting criteria are:

• the order of execution;
• the name: the title of a test or a group of tests;
• the duration of execution;
• the status tests finished with, see the list in Filter tests by status.

Filter tests by name

In the search box, enter some text to see only the tests that contain it text in their title. The filter is case-insensitive.

Filter tests by tags

• In Allure 3 click on the Tags button to select tags to filter by.
• In Allure 2 enter tag: followed by a comma-separated list of tags. The report will only show tests that have all the tags you've entered. The tag names are case-insensitive. Tags with whitespaces are not supported.

Filter tests by status

Click on the colored buttons to hide or show all the tests that finished with a specific status.

The number on each button indicates the number of tests with this status present in the hierarchy. If there are no tests with a given status in the hierarchy, then the corresponding button reads zero and does nothing.

Filter tests by marks

• In Allure 3 click on the Flaky tests, New tests or Retried tests counters above the test list, or click Transition to select one or more transitions to filter by: New, Fixed, Regressed, Malfunctioned. The Changed on retry counter, shown when there are tests whose status changed between retries, is not a filter.
• In Allure 2 click on a button with a mark icon to enable or disable a filter by a specific mark set by Allure, for example, Status changed after retry.

In Allure 3, if multiple transitions are selected, the report shows tests that have any of them. The Flaky tests and Retried tests filters work the same way: with both enabled, the report shows tests that are either flaky or retried. Different filters are combined with each other, for example, selecting the Fixed transition and the Critical severity shows only the critical tests that were fixed.

In Allure 2, if one or more filters by marks are enabled, the report will only show those tests that have all selected marks.

If no filters by marks are enabled, all tests in the hierarchy are shown.

The possible marks are: Flaky, Retry, Changed on retry (Allure 3), New, Fixed, Regressed, Malfunctioned. See Test stability analysis for more details.

Filter tests by severity Allure 3

In Allure 3 click on the Severity button to select one or more severity levels to filter by: Blocker, Critical, Normal, Minor, Trivial, or No severity for tests without a severity level. The report shows tests that have any of the selected levels.

The severity of a test is set via your Allure integration, see its documentation for details.

Filter tests by categories Allure 3

In Allure 3 click on the Categories button to select categories to filter by.

See Categories for more details.

Filter tests by environment Allure 3

In Allure 3, if the report is configured with environments, use the Environment: dropdown in the top right corner of the report to only show test results from a specific environment.

See Environments for more details.

Need more?

If you need to filter test results against a broader set of criteria, check out Allure TestOps. It allows you to filter by environment, layer, assignee, and other parameters. Add custom fields and use Allure Query Language to create even more advanced filters. Such filters are handy for collaborative work on test result analysis, especially if the number of tests is huge.