Stealthy-Require
This is probably the closest you can currently get to require something in node.js with completely bypassing the require cache.
stealthy-require
works like this:
- It clears the require cache.
- It calls a callback in which you require your module(s) without the cache kicking in.
- It clears the cache again and restores its old state.
The restrictions are:
- Native modules cannot be required twice. Thus this module bypasses the require cache only for non-native (e.g. JS) modules.
- The require cache is only bypassed for all operations that happen synchronously when a module is required. If a module lazy loads another module at a later time that require call will not bypass the cache anymore.
This means you should have a close look at all internal require calls before you decide to use this library.
Installation
This is a module for node.js and is installed via npm:
npm install stealthy-require --save
Usage
Let's say you want to bypass the require cache for this require call:
var request = require('request');
With stealthy-require
you can do that like this:
var stealthyRequire = require('stealthy-require');
var requestFresh = stealthyRequire(require.cache, function () {
return require('request');
});
The require cache is bypassed for the module you require (i.e. request
) as well as all modules the module requires (i.e. http
and many more).
Sometimes the require cache shall not be bypassed for specific modules. E.g. request
is required but tough-cookie
– on which request
depends on – shall be required using the regular cache. For that you can pass two extra arguments to stealthyRequire(...)
:
- A callback that requires the modules that shall be required without bypassing the cache
- The
module
variable
var stealthyRequire = require('stealthy-require');
var requestFresh = stealthyRequire(require.cache, function () {
return require('request');
},
function () {
require('tough-cookie'); // No return needed
// You can require multiple modules here
}, module);
Usage with Module Bundlers
- Webpack works out-of-the-box like described in the Usage section above.
- Browserify does not expose
require.cache
. However, as ofbrowserify@13.0.1
the cache is passed as the 6th argument to CommonJS modules. Thus you can pass this argument instead:
// Tweak for Browserify - using arguments[5] instead of require.cache
var requestFresh = stealthyRequire(arguments[5], function () {
return require('request');
});
Preventing a Memory Leak When Repeatedly Requiring Fresh Module Instances in Node.js
If you are using stealthy-require
in node.js and repeatedly require fresh module instances the module.children
array will hold all module instances which prevents unneeded instances to be garbage collected.
Assume your code calls doSomething()
repeatedly.
var stealthyRequire = require('stealthy-require');
function doSomething() {
var freshInstance = stealthyRequire(require.cache, function () {
return require('some-module');
});
return freshInstance.calc();
}
After doSomething()
returns freshInstance
is not used anymore but won’t be garbage collected because module.children
still holds a reference. The solution is to truncate module.children
accordingly:
var stealthyRequire = require('stealthy-require');
function doSomething() {
var initialChildren = module.children.slice(); // Creates a shallow copy of the array
var freshInstance = stealthyRequire(require.cache, function () {
return require('some-module');
});
module.children = initialChildren;
return freshInstance.calc();
}
The slice
operation removes all new module.children
entries created during the stealthyRequire(...)
call and thus freshInstance
gets garbage collected after doSomething()
returns.
Technical Walkthrough
// 1. Load stealthy-require
var stealthyRequire = require('stealthy-require');
// This does nothing but loading the code.
// It has no side-effects like patching the module loader or anything.
// Any regular require works as always.
var request1 = require('request');
// 2. Call stealthyRequire with passing the require cache and a callback.
var requestFresh = stealthyRequire(require.cache, function () {
// 2a. Before this callback gets called the require cache is cleared.
// 2b. Any require taking place here takes place on a clean require cache.
// Since the require call is part of the user's code it also works with module bundlers.
return require('request');
// Anything returned here will be returned by stealthyRequire(...).
// 2c. After this callback gets called the require cache is
// - cleared again and
// - restored to its old state before step 2.
});
// Any regular require again works as always.
// In this case require returns the cached request module instance.
var request2 = require('request');
// And voilà:
request1 === request2 // -> true
request1 === requestFresh // -> false
Contributing
To set up your development environment for stealthy-require
:
- Clone this repo to your desktop,
- in the shell
cd
to the main folder, - hit
npm install
, and - run
npm run dev
.
npm run dev
watches all source files and if you save some changes it will lint the code and execute all tests. The test coverage report can be viewed from ./coverage/lcov-report/index.html
.
If you want to debug a test you should use npm run test-no-cov
to run all tests without obscuring the code by the test coverage instrumentation.
Change History
- 2019-07-25
- Chore: Added node v12 to ci build and updated dev dependencies to support node v12
- v1.1.1 (2017-05-08)
- Fix that stops
undefined
entries from appearing inrequire.cache
(Thanks to @jasperjn from reporting this in issue #4)
- Fix that stops
- v1.1.0 (2017-04-25)
- Added ability to disable bypassing the cache for certain modules (Thanks to @novemberborn for suggesting this in issue #3)
- Added section in README about a potential memory leak (Thanks to @Flarna and @novemberborn for bringing that up in issue #2)
- Performance optimizations (Thanks to @jcready for pull request #1)
- v1.0.0 (2016-07-18)
- Breaking Change: API completely changed. Please read the Usage section again.
- Redesigned library to support module bundlers like Webpack and Browserify
- v0.1.0 (2016-05-26)
- Initial version
License (ISC)
In case you never heard about the ISC license it is functionally equivalent to the MIT license.
See the LICENSE file for details.