Allure Codeception reference

These are the attributes and methods that you can use to integrate your Codeception tests with Allure Report.

In most cases, Allure Codeception provides two different ways to use a feature: the Attributes API and the Runtime API.

  • Attributes API: add a PHP attribute to a test method or a whole class to add certain data to the test result. When using this approach, the data is guaranteed to be added regardless of how the test itself runs.

  • Runtime API: use Allure's functions to add certain data to the test result during its execution. This approach allows for constructing the data dynamically.

    Note that it is recommended to call the Allure's functions as close to the beginning of the test as possible. This way, the data will be added even if the test fails early.

Metadata

Assign a test's description, links and other metadata.

Title

  • #[DisplayName(string $value)]
  • Allure::displayName(string $name)

Set the test's title.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Attribute\DisplayName; class TestMyWebsite extends Unit { #[DisplayName('Test Labels')] public function testLabels() { // ... } }
PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; class TestMyWebsite extends Unit { public function testLabels() { Allure::displayName('Test Labels'); // ... } }

Description

  • #[Description(string $value)]
  • Allure::description(string $description)

Set the test's description. Markdown formatting is allowed. Any HTML formatting, if present, will be stripped for security purposes.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Attribute\Description; class TestMyWebsite extends Unit { #[Description('This test attempts to create a label with specified title.')] public function testLabels() { // ... } }
PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; class TestMyWebsite extends Unit { public function testLabels() { Allure::description('This test attempts to log into the website using a login and a password.'); // ... } }

Owner

  • #[Owner(string $value)]
  • Allure::owner(string $value)

Set the test's owner.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Attribute\Owner; class TestMyWebsite extends Unit { #[Owner('John Doe')] public function testLabels() { // ... } }
PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; class TestMyWebsite extends Unit { public function testLabels() { Allure::owner('John Doe'); // ... } }

Tag

  • #[Tag(string $value)]
  • Allure::tag(string $value)

Set the test's tags.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Attribute\Tag; class TestMyWebsite extends Unit { #[Tag('UI'), Tag('Labels')] public function testLabels() { // ... } }
PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; class TestMyWebsite extends Unit { public function testLabels() { Allure::tag('UI'); Allure::tag('Labels'); // ... } }

Severity

  • #[Severity(string $value)]
  • Allure::severity(Severity $value)

Set the test's severity.

For the Attributes API, use the constants from the Severity class. For the Runtime API, use the static methods on the Severity class to construct the values.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Attribute\Severity; class TestMyWebsite extends Unit { #[Severity(Severity::CRITICAL)] public function testLabels() { // ... } }
PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; use Qameta\Allure\Model\Severity; class TestMyWebsite extends Unit { public function testLabels() { Allure::severity(Severity::critical()); // ... } }

Label

  • #[Label(string $name, ?string $value = null)]
  • Allure::label(string $name, string $value)

Set an arbitrary label for the test. This is the underlying implementation for a lot of Allure's other APIs.

You may also extend the Attributes API by defining your own attribute that will work as a #[Label] with a predefined $name.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Attribute\Label; class TestMyWebsite extends Unit { #[Label('MyCustomLabel', 'value')] public function testLabels() { // ... } }
PHP
use Attribute; use Codeception\Test\Unit; use Qameta\Allure\Attribute\AbstractLabel; #[Attribute(Attribute::TARGET_CLASS | Attribute::TARGET_METHOD | Attribute::IS_REPEATABLE)] final class MyCustomLabel extends AbstractLabel { public function __construct(string $value) { parent::__construct('MyCustomLabel', $value); } } class TestMyWebsite extends Unit { #[MyCustomLabel('value')] public function testLabels() { // ... } }
PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; class TestMyWebsite extends Unit { public function testLabels() { Allure::label('MyCustomLabel', 'value'); // ... } }

ID

  • #[AllureId(string $value)]

Set the test's ID.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Attribute\AllureId; class TestMyWebsite extends Unit { #[AllureId('123')] public function testLabels() { // ... } }
  • #[Link(?string $name = null, ?string $url = null, string $type = Link::CUSTOM)]
  • #[Issue(?string $name = null, ?string $url = null)]
  • #[TmsLink(?string $name = null, ?string $url = null)]
  • Allure::link(string $url, ?string $name = null, ?LinkType $type = null)
  • Allure::issue(string $name, ?string $url = null)
  • Allure::tms(string $name, ?string $url = null)

Add a link related to the test.

Based on the type, Allure will try to load a corresponding link pattern to process the URL, as defined by the linkTemplates configuration option. If no pattern found for the given type, the URL is left unmodified.

When using the Runtime API, the type must be a value from the LinkType enumeration. When using the Attributes API, the type can be any string. Both APIs provide shorthands for the “issue” and “tms” link types.

The name will be used as the link's text. If it is omitted, the unprocessed URL will be used instead.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Attribute\Issue; use Qameta\Allure\Attribute\Link; use Qameta\Allure\Attribute\TmsLink; class TestMyWebsite extends Unit { #[Link('My Website', 'https://example.com/')] #[Issue('UI-123')] #[TmsLink('TMS-456')] public function testLabels() { // ... } }
PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; class TestMyWebsite extends Unit { public function testLabels() { Allure::link('https://example.com/', 'My Website'); Allure::issue('UI-123'); Allure::tms('TMS-456'); // ... } }

Behavior-based hierarchy

  • #[Epic(string $value)]
  • #[Feature(string $value)]
  • #[Story(string $value)]
  • Allure::epic(string $value)
  • Allure::feature(string $value)
  • Allure::story(string $value)

Assign names of epics, features or user stories for a test, as part of Allure's behavior-based hierarchy.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Attribute\Epic; use Qameta\Allure\Attribute\Feature; use Qameta\Allure\Attribute\Story; class TestMyWebsite extends Unit { #[Epic('Web interface')] #[Feature('Essential features')] #[Story('Labels')] public function testLabels() { // ... } }
PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; class TestMyWebsite extends Unit { public function testLabels() { Allure::epic('Web interface'); Allure::feature('Essential features'); Allure::story('Labels'); // ... } }

Suite-based hierarchy

  • #[ParentSuite(string $value)]
  • #[Suite(string $value)]
  • #[SubSuite(string $value)]
  • Allure::parentSuite(string $value)
  • Allure::suite(string $value)
  • Allure::subSuite(string $value)

Assign the name of the suite, as part of Allure's suite-based hierarchy.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Attribute\ParentSuite; use Qameta\Allure\Attribute\SubSuite; use Qameta\Allure\Attribute\Suite; class TestMyWebsite extends Unit { #[ParentSuite('Web interface')] #[Suite('Essential features')] #[SubSuite('Labels')] public function testLabels() { // ... } }
PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; class TestMyWebsite extends Unit { public function testLabels() { Allure::parentSuite('Web interface'); Allure::suite('Essential features'); Allure::subSuite('Labels'); // ... } }

Test steps

  • Allure::runStep(callable $callable, ?string $name = null)
  • Allure::addStep(string $name, ?Status $status = null)

Define test steps.

There are three ways of defining a step.

  • Method-based steps

    Write a test step in a public method and pass it to runStep() using the array syntax (i.e., [$obj, 'method']). The method should either accept no arguments or accept one argument of the type StepContextInterface. During the execution of a step, you can call runStep() again to create a sub-step.

    To change a step's title (defaults to just the word “step”), you can:

    • add the #[DisplayName] attribute to the method,
    • pass the optional name argument to runStep(),
    • use the name() method on the StepContextInterface object.
  • Lambda steps

    Write a test step in a lambda function and pass it to runStep(). If the lambda function returns a value, runStep() will return it without modification, and it will not affect the report. During the execution of a step, you can call runStep() again to create a sub-step.

    To change a step's title (defaults to just the word “step”), you can:

    • add the #[DisplayName] attribute to the lambda function,
    • pass the optional name argument to runStep(),
    • use the name() method on the StepContextInterface object.
  • No-op steps

    If you call addStep(), Allure will add to the report a no-op step. This allows for a log-style reporting within a test or within a larger step. A no-op step finishes immediately after it started and cannot have any sub-steps, or parameters.

    The optional second argument indicates the status that will be shown for the step in the report. Allowed values are: Status::passed() (the default), Status::failed(), Status::broken(), and Status::skipped().

During the execution of a method-based step or a lambda step, it is possible to describe the data the step works with, e.g., if you run it multiple times with different data. To do so, use the parameter() method of the StepContextInterface object.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; use Qameta\Allure\Attribute\DisplayName; use Qameta\Allure\StepContextInterface; class TestMyWebsite extends Unit { public function testLabels() { Allure::runStep([$this, 'logIn']); Allure::runStep([$this, 'createLabel']); Allure::runStep([$this, 'checkThatLabelExists']); } #[DisplayName('Log in')] function logIn(StepContextInterface $context) { $context->parameter('Email', '[email protected]'); $context->parameter('Password', 'qwerty'); // ... } #[DisplayName('Create label')] function createLabel(StepContextInterface $context) { $context->parameter('Label name', 'My Label'); // ... } #[DisplayName('Check that label exists')] function checkThatLabelExists(StepContextInterface $context) { $context->parameter('Label name', 'My Label'); // ... } }
PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; use Qameta\Allure\StepContextInterface; class TestMyWebsite extends Unit { public function testLabels() { Allure::runStep(function (StepContextInterface $context) { $context->parameter('Email', '[email protected]'); $context->parameter('Password', 'qwerty'); // ... }, 'Log in'); Allure::runStep(function (StepContextInterface $context) { $context->parameter('Label name', 'My Label'); // ... }, 'Create label'); Allure::runStep(function (StepContextInterface $context) { $context->parameter('Label name', 'My Label'); // ... }, 'Check that label exists'); } }
PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; class TestMyWebsite extends Unit { public function testLabels() { // ... Allure::addStep('Log in'); // ... Allure::addStep('Create label'); // ... Allure::addStep('Check that label exists'); } }

Parametrized tests

  • Allure::parameter(string $name, ?string $value, bool $excluded = false, ?ParameterMode $mode = null)

Specify a name and value of a parameter that was used during this test. See Parametrized tests for more details.

Note that Allure Codeception does not automatically extract the parameters from the Codeception's DataProvider. In a test function that uses a data provider, pass the names and values to Allure::parameter() manually, as shown in the example below.

If the excluded argument is set to true, Allure will not use the parameter when comparing the current test result with previous one in the history.

The mode argument affects how the parameter will be displayed in the report. Available options are:

  • null — the parameter and its value will be shown in a table along with other parameters.
  • ParameterMode::masked() — the parameter will be shown in the table, but its value will be hidden. Use this mode for passwords, tokens and other sensitive parameters.
  • ParameterMode::hidden() — the parameter and its value will not be shown in the test report. Note, however, that it is still possible to extract the value from the allure_results directory if you publish it.

The parameters can be added not only to whole test results, but also to individual steps within them, see Test steps for more details.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; class TestMyWebsite extends Unit { public function testAuthenticationWithUsername() { Allure::parameter('login', 'johndoe'); Allure::parameter('password', 'qwerty'); // ... } public function testAuthenticationWithEmail() { Allure::parameter('login', '[email protected]'); Allure::parameter('password', 'qwerty'); // ... } }
PHP
use Codeception\Attribute\DataProvider; use Codeception\Test\Unit; use Qameta\Allure\Allure; class ParametersProviderTest extends Unit { protected function dataProvider() { return [ ['login' => 'johndoe', 'password' => 'qwerty'], ['login' => '[email protected]', 'password' => 'qwerty'], ]; } #[DataProvider('dataProvider')] public function testAuthenticationWithData($login, $password) { Allure::parameter('Login', $login); Allure::parameter('Password', $password); // ... } }

Attachments

  • Allure::attachment(string $name, string $content, ?string $type = null, ?string $fileExtension = null)
  • Allure::attachmentFile(string $name, string $file, ?string $type = null, ?string $fileExtension = null)

Add an attachment to the test result under the given name.

You can use data produced by any function, not necessarily read from an actual file.

To create an attachment using the Runtime API, call Allure::attachment() or Allure::attachmentFile() at any point during your test. Pass either the content or the path from which the data will be read.

To ensure that the reader's web browser will display attachments correctly, it is recommended to specify each attachment's type. To do so, pass the MIME type of the content as type and, optionally, a filename extension as fileExtension. The MIME type affects how the data will be displayed in the test report, while the filename extension is appended to the filename when user wants to save the file.

PHP
use Codeception\Test\Unit; use Qameta\Allure\Allure; class TestMyWebsite extends Unit { public function testLabels() { // ... Allure::attachment('data.txt', 'This is the file content.', 'text/plain'); Allure::attachmentFile('data.txt', '/path/to/image.png', 'image/png'); } }
Powered by
logo

Join our newsletter

Join our community

We aim to make Allure Report as reliable and user-friendly as possible, and together with the community, we're here to help when problems arise.

© 2024 Qameta Software Inc. All rights reserved.