Node test utility
Lead Maintainer: Wyatt Preul
lab is sponsored by nearForm.
lab is a simple test utility for node. Unlike other test utilities, lab uses domains instead of uncaught exception and other global manipulation. Our goal with lab is to keep the execution engine as simple as possible, and not try to build an extensible framework. lab works with any assertion library that throws an error when a condition isn't met.
lab supports the following command line options:
-a,--assert- name of assert library to use.-c,--coverage- enables code coverage analysis.--coverage-path- sets code coverage path.--coverage-exclude- sets code coverage excludes.-C,--colors- enables or disables color output. Defaults to console capabilities.-d,--dry- dry run. Skips all tests. Use with-vto generate a test catalog. Defaults tofalse.-D,--debug- print the stack during a domain error event.-e,--environment- value to set theNODE_ENVenvironment variable to, defaults to 'test'.-f,--flat- do not perform a recursive load of test files within the test directory.-g,--grep- only run tests matching the given pattern which is internally compiled to a RegExp.-h,--help- show command line usage.-i,--id- only run the test for the given identifier (or identifiers range).-I,--ignore- ignore a list of globals for the leak detection (comma separated)-l,--leaks- disables global variable leak detection.-L,--lint- run linting rules using linter. Disabled by default.--lint-errors-threshold- maximum absolute amount of linting errors. Defaults to 0.--lint-warnings-threshold- maximum absolute amount of linting warnings. Defaults to 0.-m,--timeout- individual tests timeout in milliseconds (zero disables timeout). Defaults to 2 seconds.-M,--context-timeout- default timeouts for before, after, beforeEach and afterEach in milliseconds. Disabled by default.-n,--linter- specify linting program file path; default iseslint.--lint-options- specify options to pass to linting program. It must be a string that is JSON.parse(able).-o,--output- file to write the report to, otherwise sent to stdout.-p,--parallel- sets parallel execution as default test option. Defaults to serial execution.-P,--pattern- only load files with the given pattern in the name.-r,--reporter- the reporter used to generate the test results. Defaults toconsole. Options are:console- text report.html- HTML test and code coverage report (sets-c).json- output results in JSON format.junit- output results in JUnit XML format.tap- TAP protocol report.lcov- output to lcov format.clover- output results in Clover XML format.- Multiple Reporters - See Below
- Custom Reporters - See Below
--shuffle- randomize the order that test scripts are executed. Will not work with--id.-s,--silence- silence test output, defaults to false.-S,--sourcemaps- enables sourcemap support for stack traces and code coverage, disabled by default.-t,--threshold- sets the minimum code test coverage percentage to 100%.-T,--transform- javascript file that exports an array of objects ie.[ { ext: ".js", transform: (content, filename) => { ... } } ]. Note that if you use this option with -c (--coverage), then you must generate sourcemaps and pass sourcemaps option to get proper line numbers.-v,--verbose- verbose test output, defaults to false.-V,--version- display lab version information.
To install lab globally:
$ npm install -g labTo use locally:
$ npm install --save-dev labBy default, lab loads all the '*.js' files inside the local 'test' directory and executes the tests found. To use different directories or files, pass the file or directories as arguments:
$ lab unit.jsTest files must require the lab module, and export a test script:
const Code = require('code'); // assertion library
const Lab = require('lab');
const lab = exports.lab = Lab.script();
lab.test('returns true when 1 + 1 equals 2', (done) => {
Code.expect(1 + 1).to.equal(2);
done();
});When a test is completed, done(err) must be called, otherwise the test will time out (2 seconds by default) and will fail.
The test passes if done() is called once before the timeout, no exception thrown, and no arguments are passed to done().
If no callback function is provided, the test is considered a TODO reminder and will be skipped.
Tests can be organized into experiments:
lab.experiment('math', () => {
lab.test('returns true when 1 + 1 equals 2', (done) => {
Code.expect(1 + 1).to.equal(2);
done();
});
});If you need to perform some async actions before or after executing the tests inside an experiment, the before() and
after() methods can be used. To execute code before or after each test in an experiment, use beforeEach() and afterEach().
lab.experiment('math', () => {
lab.before((done) => {
// Wait 1 second
setTimeout(() => {
done();
}, 1000);
});
lab.beforeEach((done) => {
// Run before every single test
done();
});
lab.test('returns true when 1 + 1 equals 2', (done) => {
Code.expect(1 + 1).to.equal(2);
done();
});
});test(), before(), beforeEach(), after() and afterEach() also support returning promises instead of using the done callback:
lab.experiment('math', () => {
lab.before(() => {
const promise = aFunctionReturningAPromise();
return promise;
});
lab.test('returns true when 1 + 1 equals 2', () => {
return aFunctionReturningAPromise()
.then((aValue) => {
Code.expect(aValue).to.equal(expectedValue);
});
});
});Both test() and experiment() accept an optional options argument which must be an object with the following optional keys:
timeout- set a test or experiment specific timeout in milliseconds. Defaults to the global timeout (2000ms or the value of-m).parallel- sets parallel execution of tests within each experiment level. Defaults tofalse(serial execution).skip- skip execution. Cannot be overridden in children once parent is set to skip.only- marks all other tests or experiments withskip.
You can also append .only(…) or .skip(…) to test and experiment instead of using the options flags:
lab.experiment('with only', () => {
lab.test.only('only this test will run', (done) => {
Code.expect(1 + 1).to.equal(2);
done();
});
lab.test('another test that will not be executed', (done) => {
done();
});
});Additionally, test() options support a plan setting to specify the expected number of assertions for your test to execute. This
setting should only be used with an assertion library that supports a count() function, like code.
plan may not work with parallel test executions
lab.experiment('my plan', () => {
lab.test('only a single assertion executes', { plan: 1 }, (done) => {
Code.expect(1 + 1).to.equal(2);
done();
});
});before(), after(), beforeEach(), afterEach() accept an optional options argument which must be an object with the following optional keys:
timeout- set a specific timeout in milliseconds. Disabled by default or the value of-M.
lab.experiment('math', { timeout: 1000 }, () => {
lab.before({ timeout: 500 }, (done) => {
doSomething();
done();
});
lab.test('returns true when 1 + 1 equals 2', { parallel: true }, (done) => {
Code.expect(1 + 1).to.equal(2);
done();
});
});The script([options]) method takes an optional options argument where options is an object with the following optional keys:
schedule- iffalse, an automatic execution of the script is disabled. Automatic execution allows running lab test scripts directly with node without having to use the cli (e.g.node test/script.js). When using lab programmatically, this behavior is undesired and can be turned off by settingscheduletofalse. Defaults totrue.cli- allows setting command line options within the script. Note that the last script file loaded wins and usage of this is recommended only for temporarily changing the execution of tests. This option is useful for code working with an automatic test engine that run tests on commits. Setting this option has no effect when not using the CLI runner. For example settingclito{ ids: [1] }will only execute the first test loaded.
To make lab look like BDD:
const Code = require('code');
const Lab = require('lab');
const lab = exports.lab = Lab.script();
const describe = lab.describe;
const it = lab.it;
const before = lab.before;
const after = lab.after;
const expect = Code.expect;
describe('math', () => {
before((done) => {
done();
});
after((done) => {
done();
});
it('returns true when 1 + 1 equals 2', (done) => {
expect(1 + 1).to.equal(2);
done();
});
});To make lab look like TDD:
const Code = require('code');
const Lab = require('lab');
const lab = exports.lab = Lab.script();
const suite = lab.suite;
const test = lab.test;
const expect = Code.expect;
suite('math', () => {
test('returns true when 1 + 1 equals 2', (done) => {
expect(1 + 1).to.equal(2);
done();
});
});To use source transforms, you must specify a file with the -T command line option that tells Lab how to do the transformation. You can specify many extensions with different transform functions such as .coffee or .jsx. A sample file using the babel transpiler and the CoffeeScript compiler could look like:
const Babel = require('babel-core');
const Coffee = require('coffee-script');
const Btoa = require('btoa');
module.exports = [
{ ext: '.js', transform: (content, filename) => {
// Make sure to only transform your code or the dependencies you want
if (filename.indexOf('node_modules') === -1) {
const result = Babel.transform(content, { sourceMap: 'inline', filename: filename, sourceFileName: filename });
return result.code;
}
return content;
} },
{ ext: '.coffee', transform: (content, filename) => {
// Again, make sure to only transform your code or the dependencies you want
if (filename.indexOf('node_modules') === -1) {
const result = Coffee.compile(content, {
sourceMap: true,
inline: true,
sourceRoot: '/',
sourceFiles: [filename]
});
// append source map to end of compiled JS
return result.js +
'\n//# sourceMappingURL=data:application/json;base64,' +
Btoa(unescape(encodeURIComponent(result.v3SourceMap)));
}
return content;
} }
];Sometimes you want to disable code coverage for specific lines, and have the coverage report omit them entirely. To do so, use the $lab:coverage:(off|on)$ comments. For example:
// There is no way to cover this in node 0.10
/* $lab:coverage:off$ */
if (typeof value === 'symbol') {
return '[' + value.toString() + ']';
}
/* $lab:coverage:on$ */lab uses a shareable eslint config, and a plugin containing several hapi specific linting rules. If you want to extend the default linter you must:
-
Add
eslint-plugin-hapiandeslint-config-hapias dependencies in yourpackage.json. You must add both the plugin and the config because eslint treats them as peer dependencies. For more background, see eslint/eslint#3458 and eslint/eslint#2518. -
In your project's eslint configuration, add
"extends": "eslint-config-hapi". eslint will automatically infer theeslint-config-, so technically you can just write"extends": "hapi".
Your project's eslint configuration will now extend the default lab configuration.
Since eslint is used to lint, you can create an .eslintignore containing paths to be ignored:
node_modules/*
**/vendor/*.js
If you would like to run a different linter, or even a custom version of eslint you should
pass the -n or --linter argument with the path to the lint runner. For example,
if you plan to use jslint, you can install lab-jslint then pass --linter node_modules/lab-jslint.
- Install lab as a global module:
$ npm install -g lab- Add lab as a dev dependency to your project's
package.jsonalong with atestscript:
{
"name": "example",
"version": "1.0.0",
"dependencies": {
},
"devDependencies": {
"lab": "5.x.x"
},
"scripts": {
"test": "lab -t 100",
"test-cov-html": "lab -r html -o coverage.html"
},
"licenses": [
{
"type": "BSD",
"url": "http://github.com/hapijs/lab/raw/master/LICENSE"
}
]
}Note that npm test will execute lab with the -t 100 option which will
require 100% code coverage. Run npm run test-cov-html and check the coverage.html
file to figure out where coverage is lacking. When coverage is below the threshold,
the CLI will exit with code 1 and will result in an npm Error message.
- Run your tests with
$ npm testMultiple reporters can be specified by providing multiple reporter options.
$ lab -r console -r htmlIf any output -o is provided, they must match the same number of provided reporter options. The reporters would be paired with an output based on
the order in which they were supplied. When specifying multiple outputs, use stdout to send a particular reporter to stdout.
$ lab -r console -o stdout -r html -o coverage.html -r lcov -o lcov.info -r json -o data.jsonMultiple reporters of the same kind are also supported.
$ lab -r console -o stdout -r console -o console.logIf the value passed for reporter isn't included with Lab, it is loaded from the filesystem.
If the string starts with a period ('./custom-reporter'), it will be loaded relative to the current working directory.
If it doesn't start with a period ('custom-reporter'), it will be loaded from the node_modules directory, just like any module installed using npm install.
Reporters must be a class with the following methods: start, test and end. options are passed to the class constructor upon initialization.
See the json reporter for a good starting point.
The --coverage-exclude argument can be repeated multiple times in order to add multiple paths to exclude. By default the node_modules and test directories are excluded. If you want to exclude those as well as a directory named public you can run lab as follows:
lab -c --coverage-exclude test --coverage-exclude node_modules --coverage-exclude publiclab initial code borrowed heavily from mocha, including the actual code used to render the coverage report into HTML. lab coverage code was originally adapted from blanket which in turn uses falafel.