Sorting and filtering

The Behaviors, Suites, Packages, and Categories tabs in a test report generated by Allure (see Improving navigation in your test report) provide various ways to sort and filter the list of tests.

Filter tests by name

In the search box, enter some text to see only the tests that contain it text in their title. The filter is case-insensitive.

Allure Report filter test results by name

Filter tests by status

Click on the colored buttons to hide or show all the tests that finished with a specific status.

The number on each button indicates the number of tests with this status present in the hierarchy. If there are no tests with a given status in the hierarchy, then the corresponding button reads zero and does nothing.

Allure Report filter test results by status

Filter tests by marks

Click on a button with an icon to enable or disable a filter by a specific mark set by Allure.

If one or more filters by marks are enabled, the report will only show those tests that have all selected marks. If no filters by marks are enabled, all tests in the hierarchy are shown.

Allure Report filter test results by new/known errors, flaky or retried

The possible marks are:

Icon Name Meaning
Allure report new failed icon New failed The test finished because of a product defect, but it had any other status in the previous launch.
Allure report new passed icon New passed The test finished without any issues, but it had any other status in the previous launch.
Allure report new broken icon New broken The test finished because of a test defect, but it had any other status in the previous launch.
Allure report flaky icon Flaky The test is considered failed or broken based on the latest retry, but a previous attempt in this launch finished successfully.
Allure report retried icon Status changed after retry The test was run multiple times in this launch and finished with different results.

Note that:

  • The New failed, New passed and New broken filters depend on the history being available when the report is generated. See Tests history for more details.

  • Allure can automatically mark a test as Flaky or Retried only if the launch included two or more consecutive runs of this test. See Retries for more details.

  • Some Allure adapters provide a way to mark a test as Flaky manually. See your Allure adapter's reference for more details.

Sort tests

Click on a label in the header to change how the tests are sorted. This affects both the sorting of groups (categories, suites, etc.) and the sorting of tests within the same group. Click on an active label again to reverse the sorting order.

Allure Report sort test results by execution order, name, duration or status

The possible sorting criteria are:

  • the order of execution;
  • the name: the title of a test or a group of tests;
  • the duration of execution;
  • the status tests finished with, see the list in Filter tests by status.
Powered by
logo

Join our newsletter

Join our community

We aim to make Allure Report as reliable and user-friendly as possible, and together with the community, we're here to help when problems arise.

© 2024 Qameta Software Inc. All rights reserved.