tatami-ng

tatami-ng

Cross JavaScript runtime benchmarking library and CLI

• CLI and JS library support ✔
• Library API backward compatible with mitata up to version 0.1.14 ✔
• Benchmark latency and throughput ✔
• Support for sync and async benchmark ✔
• Advanced benchmark statistics: significance, error margin, variance, standard deviation, p-quantiles, ... ✔
• Zero cost abstraction for multiple JS runtime support ✔
• Support for ESM and TypeScript ✔

Table of contents

• Library installation
  • Node
    • npmjs
    • JSR
  • Deno
  • Bun
    • npmjs
    • JSR
  • Browser
• Library usage example
• CLI installation
  • Node
  • Deno
  • Bun
• CLI standalone binary
  • Deno
  • Bun
• CLI usage examples
• Development
• License

Library installation

Node

npmjs

npm install tatami-ng

JSR

npx jsr add @poolifier/tatami-ng

Deno

deno add @poolifier/tatami-ng

Deno versions >= 1.40.x are supported.

The --allow-hrtime permission flag is recommended to allow high-resolution time measurement.

Bun

npmjs

bun add tatami-ng

JSR

bunx jsr add @poolifier/tatami-ng

Bun versions >= 1.x are supported.

Browser

<script type="module">
import {
 ...
} from 'https://cdn.jsdelivr.net/npm/tatami-ng@0.6.0/dist/browser/index.js'
</script>

Library usage example

// adapt import to the targeted JS runtime
import { baseline, bench, group, run } from 'tatami-ng'

bench('noop', () => {})
bench('noop2', () => {})

group('group', () => {
  baseline('baseline', () => {})
  bench('Date.now()', () => {
    Date.now()
  })
  bench('performance.now()', () => {
    performance.now()
  })
})

group({ name: 'group2', summary: false }, () => {
  bench('new Array(0)', () => {
    new Array(0)
  })
  bench('new Array(1024)', () => {
    new Array(1024)
  })
})

await run({
  units: false, // print units cheatsheet (default: false)
  silent: false, // enable/disable stdout output (default: false)
  json: false, // enable/disable json output or set json output format (default: false)
  file: 'results.json', // write json output to file (default: undefined)
  colors: true, // enable/disable colors (default: true)
  samples: 128, // minimum number of benchmark samples (default: 128)
  time: 1_000_000_000, // minimum benchmark time in nanoseconds (default: 1_000_000_000)
  warmup: true, // enable/disable benchmark warmup or set benchmark warmup run(s) (default: true)
  avg: true, // enable/disable time (avg) column (default: true)
  iter: true, // enable/disable iter/s column (default: true)
  rmoe: true, // enable/disable error margin column (default: true)
  min_max: true, // enable/disable (min...max) column (default: true)
  percentiles: false, // enable/disable percentile columns (default: true)
})

CLI installation

Node

npm install tatami-ng -g

Deno

deno install -g --allow-read --allow-run --allow-sys --allow-hrtime -n tatami npm:tatami-ng

Bun

bun add tatami-ng -g

Ensure the global installation directory is in your path:

• Unix: ${HOME}/.bun/bin
• Windows: TODO

CLI standalone binary

In the cloned repository root directory, run:

Deno

bun build:cli:deno

Bun

bun build:cli:bun

The standalone binary in ./dist/<runtime_name> can be moved to a directory in your path.

CLI usage examples

tatami --help

tatami --bench 'hexdump <file>' --bench 'xxd <file>'

Development

The JavaScript runtime environment used for development is bun.

License

MIT © Evan, Jerome Benoit

Changelog

0.6.0 (2024-09-26)

⚠ BREAKING CHANGES

• remove clear() from the public API

🐞 Bug Fixes

• ensure unknown JS runtime has proper defaults (5705403)
• make standalone CLI executable generation works on Windows™ (50b3e6e)
• remove clear() from the public API (3bfdb3c)

✨ Polish

• cleanup deps for standalone binary generation (3f2329a)
• cleanup test and cli building scripts usage (44e5b93)
• enable .editorconfig in biome formatter (de27a2c)
• refine package.json cli:* scripts (20c9dfc)

🤖 Automation

• cli: fix build:cli script recursion (47aac22)
• cli: run sequentially cli build scripts (44d90e0)
• sync bun packages lock file (a064be1)