@belym.a.2105/webmake
Advanced tools
Bundle CommonJS/Node.js modules for web browsers.
Webmake allows you to organize JavaScript code for the browser the same way as you do for Node.js.
Files support can be extended to any other format that compiles to one of .js, .json, .css or .html. See custom extensions for more information.
For a more in depth look into JavaScript modules and the reason for Webmake, see the slides from my presentation at Warsaw's MeetJS: JavaScript Modules Done Right
If you wonder how Webmake compares with other solutions, see comparison section
As it has been stated, Webmake completely follows Node.js in that
Let's say in package named foo you have following individual module files:
add.js
module.exports = function () {
var sum = 0, i = 0, args = arguments, l = args.length;
while (i < l) sum += args[i++];
return sum;
};
increment.js
var add = require("./add");
module.exports = function (val) { return add(val, 1); };
program.js
var inc = require("./increment");
var a = 1;
inc(a); // 2
Let's pack program.js with all it's dependencies so it will work in browsers:
$ webmake program.js bundle.js
The generated file bundle.js now contains the following:
(function (modules) {
// about 60 lines of import/export path resolution logic
})({
foo: {
"add.js": function (exports, module, require) {
module.exports = function () {
var sum = 0, i = 0, args = arguments, l = args.length;
while (i < l) sum += args[i++];
return sum;
};
},
"increment.js": function (exports, module, require) {
var add = require("./add");
module.exports = function (val) { return add(val, 1); };
},
"program.js": function (exports, module, require) {
var inc = require("./increment");
var a = 1;
inc(a); // 2
}
}
})("foo/program");
When loaded in browser, program.js module is executed immediately.
Technically you can construct whole website that way:
body.html
<h1>Hello from NodeJS module</h1>
<p><a href="https://github.com/medikoo/modules-webmake">See Webmake for more details</a></p>
style.css
body {
font-family: Arial, Helvetica, sans-serif;
}
h1,
p {
margin: 20px;
}
p.footer {
font-size: 14px;
}
program.js
document.title = "Hello from NodeJS module";
require("./style");
document.body.innerHTML = require("./body");
var footer = document.body.appendChild(document.createElement("p"));
footer.className = "footer";
footer.innerHTML = "Generated by Webmake!";
Bundle it
$ webmake program.js bundle.js
See it working, by including it within document as such:
<!DOCTYPE html>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<body>
<script src="bundle.js"></script>
</body>
$ npm install -g webmake
$ webmake [options] <input> [<output>]
input - Path to the initial module that should be executed when script is loaded.
output - (optional) Filename at which browser ready bundle should be saved. If not provided generated bundle is streamed to stdout.
stringName at which program should be exposed in your namespace. Technically just assigns exported module to global namespace.
stringExpose bundle as AMD module. If used together with name option, module will be defined with provided name.
stringExpose bundle as CJS module.
stringAdditional module(s) that should be included but due specific reasons are not picked by parser (can be set multiple times)
stringAdditional extensions(s) that should be used for modules resolution from custom formats e.g. coffee-script or yaml.
See extensions section for more info.
boolean (command line: sourcemap)Include source maps, for easier debugging. Source maps work very well in WebKit and Chrome's web inspector. Firefox's Firebug however has some issues.
boolean (command line: ignore-errors)Ignore not parsable require paths (e.g. require('./lang/' + lang)) or not polyfilled native modules requires (e.g. require('fs')) if any.
Dynamic paths in require calls are considered a bad practice and won't be possible with upcoming ES6 modules standard. Still if we deal with modules that do that, we can workaround it by turning this option on, and including missing modules with include option.
boolean (command line: use-strict)Enforce strict mode globally. Mind that by default in node.js environment CJS modules are not executed in strict mode. Relying on that feature may rise incompatibility issues in corner case scenarios.
boolean programmatical usage onlyCache files content and its calculated dependencies. On repeated request only modified files are re-read and parsed.
Speeds up re-generation of Webmake bundle, useful when Webmake is bound to server process, see below example.
Highly recommended if extensions are used.
Defaults to false.
function programmatical usage onlyProvide a transform middleware. transform callback would be called on each module, with arguments: absolute filename and file code (as it is in origin file, before any internal transformations). If source module is meant to be processed by one of the extensions, you'll receive origin code before extension logic is applied, and you must return code that's valid for extension processor. So e.g. if you transform LESS code, you need to return valid LESS code
If you're interested only in applying transform to e.g. js files, be sure to filter your actions on basis of filename, and return code as you received if non transforms should be applied
In case of asynchronous operations, promise maybe returned, but it has to be promise that origins from deferred package.
webmake(programPath, { transform: function (filename, code) {
return transformCode(code)
} }
transformCode function should return either plain transformed code string, or an object, with code and sourceMap properties, if we want to accompany our transform with a sourceMap.
webmake(programPath[, options][, callback]);
webmake by default returns generated source to callback, but if output path is provided as one of the options, then source will be automatically saved to file
Currently best way is to use Webmake programmatically and setup a static-file server to generate bundle on each request. Webmake is fast, so it's acceptable approach even you bundle hundreds of modules at once.
You can setup simple static server as it's shown in following example script.
Example also uses node-static module to serve other static files (CSS, images etc.) if you don't need it, just adjust code up to your needs.
// Dependencies:
var createServer = require("http").createServer;
var staticServer = require("node-static").Server;
var webmake = require("webmake");
// Settings:
// Project path:
var projectPath = "/Users/open-web-user/Projects/Awesome";
// Public folder path (statics)
var staticsPath = projectPath + "/public";
// Path to js program file
var programPath = projectPath + "/lib/public/main.js";
// Server port:
var port = 8000;
// Url at which we want to serve generated js file
var programUrl = "/j/main.js";
// Setup statics server
staticServer = new staticServer(staticsPath);
// Initialize http server
createServer(function (req, res) {
// Start the flow (new Stream API demands that)
req.resume();
// Respond to request
req.on("end", function () {
if (req.url === programUrl) {
// Generate bundle with Webmake
// Send headers
res.writeHead(200, {
"Content-Type": "application/javascript; charset=utf-8",
// Do not cache generated bundle
"Cache-Control": "no-cache"
});
var time = Date.now();
webmake(programPath, { sourceMap: true, cache: true }, function (err, content) {
if (err) {
console.error("Webmake error: " + err.message);
// Expose eventual error brutally in browser
res.end(
"document.write('<div style=\"font-size: 1.6em; padding: 1em;" +
" text-align: left; font-weight: bold; color: red;" +
" position: absolute; top: 1em; left: 10%; width: 80%;" +
" background: white; background: rgba(255,255,255,0.9);" +
" border: 1px solid #ccc;\"><div>Could not generate " +
programUrl +
"</div><div style=\"font-size: 0.8em; padding-top: 1em\">" +
err.message.replace(/'/g, "\\'") +
"</div></div>');"
);
return;
}
// Send script
console.log("Webmake OK (" + ((Date.now() - time) / 1000).toFixed(3) + "s)");
res.end(content);
});
} else {
// Serve static file
staticServer.serve(req, res);
}
});
}).listen(port);
console.log("Server started");
See webmake-middleware prepared by Gilles Ruppert.
See grunt-webmake prepared by Sakata Makoto.
When you work with old school scripts or framework that uses different modules system, then you'd rather just bundle needed utilities (not whole application) and expose them to global scope.
Webassemble written by Ken Chen provides a convinient way to expose different packages, written CJS style, to outer scripts. It automatically creates one entry package that does the job and is used as a starting point for a Webmake bundle.
Submit any missing extension via new issue form.
Install chosen extension:
EXT should be replaced by name of available extension of your choice.
$ npm install webmake-EXT
If you use global installation of Webmake, then extension also needs to be installed globally:
$ npm install -g webmake-EXT
When extension is installed, you need to ask Webmake to use it:
$ webmake --ext=EXT program.js bundle.js
Same way if used programmatically:
webmake(inputPath, { ext: "EXT" }, cb);
Multiple extensions can be used together:
$ webmake --ext=EXT --ext=EXT2 program.js bundle.js
Programmatically:
webmake(inputPath, { ext: ["EXT", "EXT2"] }, cb);
Prepare a webmake-* NPM package (replace '*' with name of your extension), where main module is configured as in following example:
// Define a file extension of a new format, can be an array e.g. ['sass', 'scss']
exports.extension = "coffee";
// Which type is addressed by extension (can be either 'js', 'json', 'css' or 'html')
exports.type = "js";
// Define a compile function, that for given source code, produces valid body of a JavaScript module:
exports.compile = function (source, options) {
// Return plain object, with compiled body assigned to `code` property.
return { code: compile(source) };
// If compilation for some reason is asynchronous then assign promise
// (as produced by deferred library) which resolves with expected code body
return { code: compileAsync(source) };
// If custom format provides a way to calculate a source map and `sourceMap` options is on
// it's nice to generate it:
var data, map, code;
if (options.sourceMap) {
data = compile(source, { sourceMap: true });
// Include original file in the map.
map = JSON.parse(data.sourceMap);
map.file = options.generatedFilename;
map.sources = [options.localFilename];
map.sourcesContent = [source];
map = JSON.stringify(map);
return { code: code, sourceMap: map };
}
};
Extension doesn't need to be installed as package, you may pass it programmatically:
webmake(
inputPath,
{
ext: {
name: "coffee-script",
extension: "coffee",
type: "js",
compile: function (source, options) {
/* ... */
}
}
},
cb
);
See below writing extensions section to see how to configure fully working extensions
Be sure to state the right type, and return string that reflects addressed format (not JavaScript code) e.g. extension for CSS:
exports.extension = "less";
exports.type = "css";
exports.compile = function (source, options) {
return { code: compileToCSS(source) }; // `compileToCSS` returns plain CSS string
};
Publish it and refer to Using extensions section for usage instructions.
Finally if everything works, please let me know, so I can update this document with link to your extension.
AMD is different format, and although most popular loader for AMD is named RequireJS it works very differently from require as introduced earlier with CommonJS (one that Webmake handles).
Main idea behind AMD is that dependencies are resolved asynchronously (in contrary to synchronous resolution in case of CommonJS format). Sounds promising, but does it really make things better? Cause of waterfall nature of resolution and large number of HTTP requests not necessary. See benchmark that compares resolution speed of both formats when used in development mode.
Agreed advantage of AMD that attributes to its success is that in it's direct form works in a browser (it doesn't require any server setup), that is hard to achieve with CJS style (but not impossible). Still due to large number of requests such approach is usually not suitable for production and it appears it's also not that performant in development mode.
Quirks of AMD style is that it requires you to wrap all your modules with function wrappers, its modules are not runnable in direct form in Node.js and dependency resolution rules are basic and limited if you compare it with design of node.js + npm ecosystem.
Browserify is most popular CJS bundler, and shares very similar idea. The subtle difference is that Browserify is about porting code as written for node.js to web browser, so apart of resolving dependencies and bundling the code it struggles to bring what is needed and possible from Node.js API to the browser.
Webmake cares only about bringing node.js modules format to other environments. Conceptually it's addition to ECMAScript and not port of node.js to browser. It makes node.js modules format runnable in any environment that speaks at least ECMAScript 3. You can bundle with Webmake for Browser, TV, Adobe Photoshop or maybe a modern dishwasher.
When comparing with other CJS bundlers, main difference would be that Webmake completely follows resolution logic as it works in node.js. It resolves both packages and modules exactly as node.js, and it doesn't introduce any different ways to do that. Thanks to that, you can be sure that your modules are runnable in it's direct form both on server and client-side.
Other important difference is that Webmake doesn't do full AST scan to parse require's out of modules, it relies on find-requires module, which does only what's necessary to resolve dependencies list, and that makes it a noticeably faster solution.
Soon to be released, native JavaScript modules spec shares the main concept with CommmonJS. Thanks to that eventual transition will be easy and can be fully automated. First transpilers are already here.
As soon as the standard will be finalized, implemented in first engines and possibly adapted by node.js Webmake will support it natively as well, then in a same way it will bundle it either for the sake of a bundle or for any ECMAScript 3+ environment that won't take it in natural way.
The application calculates dependencies via static analysis of source code
(with the help of the find-requires module). So in some edge cases
not all require calls can be found. You can workaround that with help
of include option
Only relative paths and outer packages paths are supported, following will work:
require("./module-in-same-folder");
require("./module/path/deeper");
require("./some/very/very/very/long" + "/module/path");
require("../../module-path-up"); // unless it doesn't go out of package scope
require("other-package");
require("other-package/lib/some-module");
But this won't:
require("/Users/foo/projects/awesome/my-module");
Different versions of same package will collide:
Let's say, package A uses version 0.2 of package C and package B uses version 0.3 of the same package. If both package A and B are required, package B will most likely end up buggy. This is because webmake will only bundle the version that was called first. So in this case package B will end up with version 0.2 instead of 0.3.
$ npm test
Vitaly pushed forward development of support for JSON files, extensions functionality, along with webmake-yaml extension. Vitaly is a member of a team that is behind js-yaml JavaScript YAML parser and dumper, and powerful social platform Nodeca. Big Thank You Vitaly!
'Issue 2198: @sourceURL doesn't work in eval() in some cases'
1.1.2 (2020-04-01)
FAQs
Node.js/CJS modules bundler
We found that @belym.a.2105/webmake demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Research
Security News
Socket’s threat research team has detected six malicious npm packages typosquatting popular libraries to insert SSH backdoors.
Security News
MITRE's 2024 CWE Top 25 highlights critical software vulnerabilities like XSS, SQL Injection, and CSRF, reflecting shifts due to a refined ranking methodology.
Security News
In this segment of the Risky Business podcast, Feross Aboukhadijeh and Patrick Gray discuss the challenges of tracking malware discovered in open source softare.