tatami-ng

tatami-ng

Cross JavaScript runtime benchmarking library and CLI

• CLI and JS library support ✔
• Library API backward compatible with mitata ✔
• Benchmark latency and throughput ✔
• Support for sync and async benchmark ✔
• Advanced benchmark statistics: significance, error margin, variance, standard deviation, p-quantiles, ... ✔
• Zero cost abstraction for multiple JS runtime support ✔
• Support for ESM and TypeScript ✔

Table of contents

• Library installation
  • Node
    • npmjs
    • JSR
  • Deno
  • Bun
    • npmjs
    • JSR
  • Browser
• Library usage example
• CLI installation
  • Node
  • Bun
• CLI standalone binary
• CLI usage examples
• Development
• License

Library installation

Node

npmjs

npm install tatami-ng

JSR

npx jsr add @poolifier/tatami-ng

Deno

deno add @poolifier/tatami-ng

Deno versions >= 1.40.x are supported.

The --allow-hrtime permission flag is recommended to allow high-resolution time measurement.

Bun

npmjs

bun add tatami-ng

JSR

bunx jsr add @poolifier/tatami-ng

Bun versions >= 1.x are supported.

Browser

<script type="module">
import {
 ...
} from 'https://cdn.jsdelivr.net/npm/tatami-ng@0.5.2/dist/browser/index.js'
</script>

Library usage example

// adapt import to the targeted JS runtime
import { baseline, bench, clear, group, run } from 'tatami-ng';

bench('noop', () => {});
bench('noop2', () => {});

group('group', () => {
  baseline('baseline', () => {});
  bench('Date.now()', () => {
    Date.now();
  });
  bench('performance.now()', () => {
    performance.now();
  });
});

group({ name: 'group2', summary: false }, () => {
  bench('new Array(0)', () => {
    new Array(0);
  });
  bench('new Array(1024)', () => {
    new Array(1024);
  });
});

await run({
  units: false, // print units cheatsheet (default: false)
  silent: false, // enable/disable stdout output (default: false)
  json: false, // enable/disable json output or set json output format (default: false)
  file: 'results.json', // write json output to file (default: undefined)
  colors: true, // enable/disable colors (default: true)
  samples: 128, // minimum number of benchmark samples (default: 128)
  time: 1_000_000_000, // minimum benchmark time in nanoseconds (default: 1_000_000_000)
  warmup: true, // enable/disable benchmark warmup or set benchmark warmup run(s) (default: true)
  avg: true, // enable/disable time (avg) column (default: true)
  iter: true, // enable/disable iter/s column (default: true)
  rmoe: true, // enable/disable error margin column (default: true)
  min_max: true, // enable/disable (min...max) column (default: true)
  percentiles: false, // enable/disable percentile columns (default: true)
});

clear();

CLI installation

Node

npm install tatami-ng -g

Bun

bun add tatami-ng -g

Ensure the global installation directory is in your path:

• Unix: ${HOME}/.bun/bin
• Windows: TODO

CLI standalone binary

In the cloned repository root directory, run:

deno compile --allow-read --allow-run --allow-sys --allow-hrtime --output=tatami ./cli.js

The standalone binary can be moved to a directory in your path.

CLI usage examples

tatami --help

tatami --bench 'hexdump <file>' --bench 'xxd <file>'

Development

The JavaScript runtime environment used for development is bun.

License

MIT © Evan, Jerome Benoit

Changelog

0.5.2 (2024-07-10)

🚀 Features

• allow to specify the number of warmup runs (9f29086)
• cli: allow to execute custom commands at benchmarking steps (69c1fdc)

✨ Polish

• cleanup empty function usage (007345d)