Sorting and filtering
The Behaviors, Suites, Packages, and Categories tabs in a test report generated by Allure (see Improving navigation in your test report) provide various ways to sort and filter the list of tests.
Filter tests by name
In the search box, enter some text to see only the tests that contain it text in their title. The filter is case-insensitive.
Filter tests by status
Click on the colored buttons to hide or show all the tests that finished with a specific status.
The number on each button indicates the number of tests with this status present in the hierarchy. If there are no tests with a given status in the hierarchy, then the corresponding button reads zero and does nothing.
Filter tests by marks
Click on a button with an icon to enable or disable a filter by a specific mark set by Allure.
If one or more filters by marks are enabled, the report will only show those tests that have all selected marks. If no filters by marks are enabled, all tests in the hierarchy are shown.
The possible marks are:
Icon | Name | Meaning |
---|---|---|
New failed | The test finished because of a product defect, but it had any other status in the previous launch. | |
New passed | The test finished without any issues, but it had any other status in the previous launch. | |
New broken | The test finished because of a test defect, but it had any other status in the previous launch. | |
Flaky | The test is considered failed or broken based on the latest retry, but a previous attempt in this launch finished successfully. | |
Status changed after retry | The test was run multiple times in this launch and finished with different results. |
Note that:
The New failed, New passed and New broken filters depend on the history being available when the report is generated. See Tests history for more details.
Allure can automatically mark a test as Flaky or Retried only if the launch included two or more consecutive runs of this test. See Retries for more details.
Some Allure adapters provide a way to mark a test as Flaky manually. See your Allure adapter's reference for more details.
Sort tests
Click on a label in the header to change how the tests are sorted. This affects both the sorting of groups (categories, suites, etc.) and the sorting of tests within the same group. Click on an active label again to reverse the sorting order.
The possible sorting criteria are:
- the order of execution;
- the name: the title of a test or a group of tests;
- the duration of execution;
- the status tests finished with, see the list in Filter tests by status.