What is @wdio/allure-reporter?
@wdio/allure-reporter is a WebdriverIO plugin that allows you to generate Allure Test Reports. Allure is a flexible, lightweight multi-language test report tool that not only shows a very concise representation of what has been tested in a neat web report form but also allows everyone participating in the development process to extract maximum of useful information from everyday execution of tests.
What are @wdio/allure-reporter's main functionalities?
Adding Labels
This feature allows you to add custom labels to your tests. Labels can be used to categorize and filter tests in the Allure report.
const { addLabel } = require('@wdio/allure-reporter').default;
addLabel('feature', 'Login');
Adding Steps
This feature allows you to add steps to your tests. Steps provide a detailed breakdown of the actions performed during the test execution.
const { addStep } = require('@wdio/allure-reporter').default;
addStep('Open login page');
Adding Attachments
This feature allows you to add attachments to your tests. Attachments can include screenshots, logs, or any other relevant files.
const { addAttachment } = require('@wdio/allure-reporter').default;
addAttachment('Screenshot', Buffer.from('...'), 'image/png');
Adding Test Case ID
This feature allows you to link your tests to external test case management systems by adding a test case ID.
const { addTestId } = require('@wdio/allure-reporter').default;
addTestId('TC-1234');
Adding Severity
This feature allows you to specify the severity of a test case, which can be useful for prioritizing test results.
const { addSeverity } = require('@wdio/allure-reporter').default;
addSeverity('critical');
Other packages similar to @wdio/allure-reporter
mochawesome
Mochawesome is a custom reporter for the Mocha JavaScript test framework that generates a visually appealing HTML/CSS report. It provides similar functionalities to @wdio/allure-reporter, such as detailed test reports and the ability to include screenshots and other attachments.
jest-html-reporter
jest-html-reporter is a Jest test results processor that creates a simple HTML report. While it does not offer as many customization options as @wdio/allure-reporter, it provides a straightforward way to generate test reports for Jest.
cucumber-html-reporter
cucumber-html-reporter is a Cucumber.js reporter that generates a beautiful HTML report. It is similar to @wdio/allure-reporter in that it provides detailed test reports, but it is specifically designed for use with Cucumber.js.
WDIO Allure Reporter
A WebdriverIO reporter plugin to create Allure Test Reports.
Installation
The easiest way is to include @wdio/allure-reporter
as a devDependency in your package.json
.
{
"devDependencies": {
"@wdio/allure-reporter": "^7.0.0"
}
}
You can simply do it by:
npm install @wdio/allure-reporter --save-dev
Configuration
Configure the output directory in your wdio.conf.js file:
export const config = {
reporters: [['allure', {
outputDir: 'allure-results',
disableWebdriverStepsReporting: true,
disableWebdriverScreenshotsReporting: true,
}]],
}
Supported Allure API
addLabel(name, value)
- assign a custom label to testaddFeature(featureName)
β assign features to testaddStory(storyName)
β assign user story to testaddSeverity(value)
β assign severity to test, accepts one of these values: blocker, critical, normal, minor, trivialaddTag(value)
β assign a tag label to testaddEpic(value)
β assign an epic label to testaddOwner(value)
β assign an owner label to testaddSuite(value)
β assign a suite label to testaddSubSuite(value)
β assign a sub suite label to testaddParentSuite(value)
β assign a parent suite label to testaddIssue(value)
β assign issue id to testaddAllureId(value)
β assign allure test ops id label to testaddTestId(value)
β assign TMS test id to test- ~~
addEnvironment(name, value)
~~ β a deprecated function that no longer works. Use reportedEnvironmentVars
instead addAttachment(name, content, [type])
β save attachment to test.
name
(String) - attachment name.content
β attachment content.type
(String, optional) β attachment MIME-type, text/plain
by default
addArgument(name, value)
- add an additional argument to testaddDescription(description, [type])
β add description to test.
description
(String) - description of the test.type
(String, optional) β description type, text
by default. Values ['text', 'html','markdown']
addStep(title, [{content, name = 'attachment'}], [status])
- add step to test.
title
(String) - name of the step.content
(String, optional) - step attachmentname
(String, optional) - step attachment name, attachment
by default.status
(String, optional) - step status, passed
by default. Must be "failed", "passed" or "broken"
startStep(title)
- start with a step
title
(String) - name of the step.
endStep(status)
- end with a step
status
(String, optional) - step status, passed
by default. Must be "failed", "passed" or "broken"
step(name, body)
- starts step with content function inside. Allows to create steps with infinite hierarchy
body
(Function) - the step body async function
Usage
Allure Api can be accessed using:
CJS
const allureReporter = require('@wdio/allure-reporter').default
ESM
import allureReporter from '@wdio/allure-reporter'
Mocha example
describe('Suite', () => {
it('Case', () => {
allureReporter.addFeature('Feature')
})
})
Cucumber
Basic Cucumber example:
Given('I include feature and story name', () => {
allureReporter.addFeature('Feature_name');
allureReporter.addStory('Story_name');
})
Custom steps
step
method simplifies dealing with steps because each step present as an async function with any content inside.
The first argument of the function is the current step, that has most of the allure API methods (such as label
, epic
, attach
etc):
allureReporter.step('my step name', async (s1) => {
s1.label('foo', 'bar')
await s1.step('my child step name', async (s2) => {
})
})
Cucumber Tags
Cucumber tags with special names (issue
and testId
) are converted to the links (the corresponding link templates must be configured before):
@issue=BUG-1
@testId=TST-2
Feature: This is a feature with global tags that will be converted to Allure links
@issue=BUG-3
@testId=TST-4
Scenario: This is a scenario with tags that will be converted to Allure links
Given I do something
Cucumber tags with special names (feature
) are mapped to Allure labels:
Feature: Test user role
@feature=login
Scenario: Login
Given I test login
Displaying the report
The results can be consumed by any of the reporting tools offered by Allure. For example:
Command-line
Install the Allure command-line tool, and process the results directory:
allure generate [allure_output_dir] && allure open
This will generate a report (by default in ./allure-report
), and open it in your browser.
Autogenerate Report
You can also auto-generate the report by using the Allure command line tool programmatically. To do so install the package in your project by:
npm i allure-commandline
Then add or extend your onComplete
hook or create a custom service for this:
const allure = require('allure-commandline')
export const config = {
onComplete: function() {
const reportError = new Error('Could not generate Allure report')
const generation = allure(['generate', 'allure-results', '--clean'])
return new Promise((resolve, reject) => {
const generationTimeout = setTimeout(
() => reject(reportError),
5000)
generation.on('exit', function(exitCode) {
clearTimeout(generationTimeout)
if (exitCode !== 0) {
return reject(reportError)
}
console.log('Allure report successfully generated')
resolve()
})
})
}
}
Jenkins
Install and configure the Allure Jenkins plugin
Add Screenshots
Screenshots can be attached to the report by using the takeScreenshot
function from WebDriverIO in the afterTest
hook for Mocha and Jasmine or afterStep
hook for Cucumber.
First set disableWebdriverScreenshotsReporting: false
in reporter options, then add in afterStep hook:
Mocha / Jasmine
afterTest: async function(test, context, { error, result, duration, passed, retries }) {
if (error) {
await browser.takeScreenshot();
}
}
Cucumber
afterStep: async function (step, scenario, { error, duration, passed }, context) {
if (error) {
await browser.takeScreenshot();
}
}
As shown in the example above, when this function is called, a screenshot image will be attached to the allure report.