Publish pretty behave reports on Jenkins
This is a Java Jenkins plugin which publishes pretty html reports showing the results of behave runs. Just make sure to use the json formatter, like this 'behave -f=json.pretty -o=reports/output.json'.
Background
Behave is a test automation tool following the principles of Behavioural Driven Design and living documentation. Specifications are written in a concise human readable form and executed in continuous integration.
This plugin allows Jenkins to publish the results as pretty html reports hosted by the Jenkins build server. In order for this plugin to work you must be using the JUnit runner and generating a json report. The plugin converts the json report into an overview html linking to separate feature file htmls with stats and results.
Install
-
Get Jenkins.
-
Install the Behave Reports plugin.
-
Restart Jenkins.
Read this if you need further detailed install and configuration instructions
Use
You must use a Freestyle project type in jenkins.
With the behave-reports plugin installed in Jenkins, you simply check the "Publish behave results as a report" box in the publish section of the build config:
![check the publish behave-reports box] (https://github.com/willowmck/behave-reports-plugin/raw/master/.README/publish-box.png)
If you need more control over the plugin you can click the Advanced button for more options:
![check the publish behave-reports box] (https://github.com/willowmck/behave-reports-plugin/raw/master/.README/advanced-publish-box.png)
- Leave empty for the plugin to automagically find your json files or enter the path to the json reports relative to the workspace if for some reason the automagic doesn't work for you
- Leave empty unless your jenkins is installed on a different url to the default hostname:port - see the wiki for further info on this option
- Tick if you want Skipped steps to cause the build to fail - see further down for more info on this
- Tick if you want Not Implemented/Pending steps to cause the build to fail - see further down for more info on this
- Tick if you want failed test not to fail the entire build but make it unstable
When a build runs that publishes behave results it will put a link in the sidepanel to the behave reports. There is a feature overview page:
![feature overview page] (https://github.com/willowmck/behave-reporting/raw/master/.README/feature-overview.png)
And there are also feature specific results pages:
![feature specific page passing] (https://github.com/willowmck/behave-reporting/raw/master/.README/feature-passed.png)
And useful information for failures:
![feature specific page failing] (https://github.com/willowmck/behave-reporting/raw/master/.README/feature-failed.png)
If you have tags in your behave features you can see a tag overview:
![Tag overview] (https://github.com/willowmck/behave-reporting/raw/master/.README/tag-overview.png)
And you can drill down into tag specific reports:
![Tag report] (https://github.com/willowmck/behave-reporting/raw/master/.README/tag-report.png)
Advanced Configuration Options
There are 4 advanced configuration options that can affect the outcome of the build status. Click on the Advanced tab in the configuration screen:
![Advanced Configuration] (https://github.com/willowmck/behave-reports-plugin/raw/master/.README/advanced_options.png)
The first setting is Skipped steps fail the build - so if you tick this any steps that are skipped during executions will be marked as failed and will cause the build to fail:
If you check both skipped and not implemented fails the build then your report will look something like this:
Make sure you have configured behave to run with the JUnit runner and to generate a json report: (note - you can add other formatters in if you like e.g. pretty - but only the json formatter is required for the reports to work)
behave -f=json.pretty -o=reports/output.json
Develop
Interested in contributing to the Jenkins behave-reports plugin? Great! Start [here] (https://github.com/willowmck/behave-reports-plugin).