🎛️ Regulo
🔥 Control the heat

A concurrency limiter with a built-in circuit breaker, so the expensive parts of your system never boil over. Regulo is a priority-queue semaphore with weighted permits, a saturation circuit breaker, adaptive backoff, and built-in windowed metrics. Zero dependencies, ships ESM and CJS, runs on Node.js and other modern JavaScript runtimes.
Like the dial on a gas range, Regulo sits between incoming work and the burner. Most concurrency libraries just cap how many things run at once and stop there. Regulo is built for the case where that limit is protecting something expensive — SSR rendering, a database pool, a downstream API — and you need to watch the flame, send the important pots to the front, and turn things down cleanly before the system scorches.
✨ Highlights
- 🎛️ Bounded concurrency, with priority and weighting — set how many burners are lit, send important work to the front, and let one heavy job claim more than one burner.
- 🛡️ Saturation circuit breaker — when work backs up faster than it clears, Regulo takes the pot off the heat: it opens the circuit and sheds load immediately, then probes for recovery and closes again on its own. (See How the circuit breaker works — it trips on saturation, not on your operation's errors.)
- 🌡️ Adaptive backoff — during a timeout burst, dispatch eases down to a simmer and returns to a full boil on its own once things recover.
- 📈 Built-in observability — windowed 1m/5m/15m/1h/24h rollups (throughput, latency, queue depth, in-flight), lifetime counters, and an event stream, all through one
status() call.
- ⏳ Head-of-line fairness — once a caller is in line, nobody jumps the queue ahead of it.
- 🪶 Tiny footprint, no supply-chain surface — roughly 6.6 KB min+gzip (~26 KB minified, ~6.1 KB brotli) with zero runtime dependencies, so there's nothing transitive to audit, update, or trust. Tree-shakeable ESM.
- 🧯 Production-minded — graceful
drain(), reset(), cancel(), and shutdown(); stale-task purging; double-release safety; strict-mode TypeScript types.
📦 Install
npm install regulo
Requires Node.js >= 20 (or any runtime providing AbortSignal, queueMicrotask, and timers).
🚀 Quick start
import { Semaphore } from 'regulo';
const semaphore = new Semaphore(10);
const result = await semaphore.use(async () => {
return await expensiveOperation();
});
use() acquires a permit, runs your function, and releases the permit afterward — even if the function throws. The primary export is the Semaphore class; regulo is the dial wrapped around it.
⚖️ How it compares
Regulo overlaps with several well-known libraries but sits at the intersection of bounded concurrency, prioritization, and resilience, with built-in observability.
| Bounded concurrency | Yes | Yes | Yes | No | Yes (bulkhead) |
| Priority queue | Yes | No | Yes | — | No |
| Weighted permits | Yes | No | No | — | No |
| Circuit breaker | Yes | No | No | Yes | Yes |
| Adaptive backoff | Yes | No | No | No | No |
| Windowed metrics | Yes | No | Basic | Yes | No |
| Dependencies | Zero | Minimal | Minimal | Several | Zero |
Capabilities reflect each project's commonly documented feature set at the time of writing; check the respective projects for their current state. If you only need a concurrency cap, p-limit is smaller and simpler. If you need rich resilience policy composition (retry, timeout, fallback), cockatiel is a strong choice. Reach for regulo when you want prioritized, weighted concurrency limiting that you can monitor and that protects itself under sustained load.
🎯 Core concepts
Semaphore — holds a fixed pool of permits (the burners). Callers acquire a permit before doing work and release it when done. When all permits are held, callers queue until one frees up, or until their timeout fires.
Weighted permits — a single acquire can consume more than one permit (weight). Big pots need more burners, so heavier work reserves proportionally more of the pool.
Priority queue — queued callers are dispatched in ascending priority order (lower number = higher priority — the front burner). Default priority is 0. Dispatch is head-of-line fair: once any caller is queued, later callers always queue behind it rather than grabbing a free permit, so a lower-priority or lighter task can never jump ahead of a waiting higher-priority or heavier one.
Queue ordering — queueOrder selects a dispatch preset. Priority and arrival order are two independent axes. 'fifoWithPriority' (the default) and 'lifoWithPriority' keep priority as the primary sort key and break equal-priority ties earliest- or latest-enqueued first. 'fifo' and 'lifo' drop priority entirely and order purely by enqueue time. For full control, pass a comparator (lower sorts/dispatches first), which overrides queueOrder:
import { Semaphore, QUEUE_ORDERINGS } from 'regulo';
const a = new Semaphore(4, { queueOrder: 'lifo' });
const b = new Semaphore(4, {
comparator: (x, y) => (x.priority - y.priority) || (x.weight - y.weight) || (x.id - y.id),
});
const c = new Semaphore(4, { comparator: QUEUE_ORDERINGS.lifoWithPriority });
See Choosing an ordering for how the ordering interacts with weighted permits and head-of-line dispatch — the choice has real throughput consequences under mixed weights.
Circuit breaker — watches for saturation and takes the pot off the heat when the system can't keep up. See the dedicated section below for exactly what it measures.
Backoff — exponential backoff eases dispatch down to a simmer during sustained timeout bursts. The delay grows on each timeout and decays continuously over time, throttling dispatch while downstream systems recover and returning to zero on its own once the burst subsides. The current delay is exposed in status() and TASKTIMEOUT events.
🧭 Choosing an ordering, and its implications
Two facts are true of every ordering, because they live in the scheduler, not the comparator:
- Dispatch follows the configured order strictly. Whatever sorts to the head dispatches next; nothing behind it jumps ahead (head-of-line fairness).
- The scheduler will not dispatch past a head that doesn't fit. With weighted permits, if the head needs more permits than are currently free, the scheduler waits for capacity to accumulate rather than skipping to a lighter task behind it. A free permit can therefore sit idle while the head waits. This prevents a lighter/lower-priority task from starving a heavier/higher-priority one — but under a wide weight distribution it can also stall throughput while the head waits.
That second rule is where the comparator choice matters: the rule is fixed, but which task ends up at the head — and therefore how often the stall bites — is entirely up to your ordering.
fifoWithPriority (default) | lowest priority value, ties earliest-first | A heavy task only holds the line while it is genuinely the highest-priority (or earliest equal-priority) waiter |
lifoWithPriority | lowest priority value, ties latest-first | Same, but equal-priority ties favor the newest |
fifo | earliest enqueued (priority ignored) | Classic head-of-line: whoever arrived first holds the line until it fits |
lifo | latest enqueued (priority ignored) | The newest arrival holds the line until it fits |
| custom, heaviest-first | heaviest weight | Worst case — deliberately parks the heaviest task at the head, maximizing the stall |
| custom, lightest-first | lightest weight | Minimizes stalls — light work drains while capacity accumulates for heavy work |
If you mix many light acquires with a few heavy ones and care about throughput, prefer a lightest-first tiebreaker (e.g. (a, b) => (a.priority - b.priority) || (a.weight - b.weight) || (a.id - b.id)), or give each weight class its own Semaphore so a heavy head in one pool can't stall the other. Conversely, if you must not let light work starve heavy work, the default's strict behavior is what you want.
Weight is a cost multiplier, not a task-type selector. weight exists to say "this unit of work costs N burners," for work drawing on the same resource pool and same failure domain. Don't use weight (or priority) to multiplex unrelated task types or downstreams through one Semaphore — the breaker and backoff are shared across everything in the instance (see Caveats). Use one Semaphore per resource instead.
💡 How the circuit breaker works
The breaker is a saturation breaker, not a fault breaker. It watches the rate of queue-acquisition timeouts — callers that waited longer than queueMaxTimeout for a permit — over a sliding window. When that rate crosses circuitBreakerThreshold (and the minimum count guards are met), the circuit opens and new requests are rejected immediately with CIRCUIT_OPEN. After the cooldown elapses, one probe request is allowed through; if it succeeds the circuit closes, if it times out the circuit re-opens and the cooldown restarts.
What this means in practice:
- The breaker trips when work backs up faster than permits free — the signature of a saturated or slow downstream. This is what protects the pool: it pulls everything off the heat before the pot boils over.
- The breaker does not trip on errors thrown by the function you run inside
use(). If your operation fails fast, the permit is released normally and the failure never reaches the breaker.
If you also need to trip on downstream errors (not just saturation), pair the semaphore with a conventional fault breaker around your operation, or use the standalone CircuitBreaker and feed it your own failure signal.
🥘 Recipe: Express middleware
Cap concurrent handling of an expensive route and shed load with a 503 when the circuit is open or the queue is full:
import { Semaphore, SemaphoreError, SemaphoreEvents } from 'regulo';
import type { RequestHandler } from 'express';
export function limit(semaphore: Semaphore): RequestHandler {
return async (req, res, next) => {
let release: (() => void) | undefined;
try {
release = await semaphore.acquire();
} catch (error) {
if (error instanceof SemaphoreError) {
res.setHeader('Retry-After', '5').sendStatus(503);
return;
}
return next(error);
}
res.once('close', release);
next();
};
}
const reports = new Semaphore(20, { queueMaxLength: 100, queueMaxTimeout: 2000 });
app.get('/report', limit(reports), async (req, res) => {
res.json(await buildExpensiveReport(req.query));
});
app.get('/metrics/semaphore', (_req, res) => res.json(reports.status()));
reports.on(SemaphoreEvents.CIRCUITOPEN, ({ timeoutRate }) => logger.warn(`reports limiter shedding load (timeout rate ${(timeoutRate * 100).toFixed(0)}%)`));
reports.on(SemaphoreEvents.CIRCUITCLOSE, () => logger.info('reports limiter recovered'));
📚 API reference
new Semaphore(count, config?)
Creates a semaphore with count permits.
acquire(abortSignal?, priority?, weight?): Promise<() => void>
Acquires a permit. Returns a release closure. Queues if no permit is available.
priority — Dispatch priority (any finite number; lower dispatches first). Defaults to 0. Non-finite values (NaN, Infinity) reject with INVALID_PRIORITY.
weight — Permits to consume (integer in 1..count). Defaults to 1. Invalid weights reject with INVALID_WEIGHT.
const release = await semaphore.acquire(abortController.signal, 1, 2);
try {
await doWork();
} finally {
release();
}
use<T>(fn, abortSignal?, priority?, weight?): Promise<T>
Preferred entry point. Acquires a permit, runs fn(), and releases — always, even if fn throws.
tryAcquire(weight?): (() => void) | null
Non-blocking. Returns a release closure, or null if insufficient permits are available or any tasks are already queued (head-of-line fairness — tryAcquire never jumps the queue).
weight — Permits to consume (integer in 1..count). Defaults to 1. Invalid weights return null.
drain(timeoutMs?): Promise<void>
Resolves when the queue is empty and all permits are returned. Multiple callers share the same promise. Pass timeoutMs (a positive integer) to set a deadline — rejects with TIMEOUT if not idle in time; an invalid value throws synchronously.
Without timeoutMs, drain() can block indefinitely if a caller holds a permit and never releases it.
reset(options?): void
Rejects all queued tasks (SHUTDOWN) and restores the semaphore to its initial state. Event listeners are preserved unless { clearListeners: true } is passed.
cancel(): void
Rejects all currently queued tasks with CANCELLED. In-flight permits are unaffected and the semaphore remains fully operational (unlike shutdown()).
shutdown(reason?): void
Permanently stops the semaphore — kills the gas. All queued tasks are rejected. Unlike reset(), this cannot be reversed.
on(event, listener) / off(event, listener) / removeAllListeners(event?)
Standard event emitter interface. See Events reference below.
status()
Returns a snapshot of current operating state. See status() output for the full shape.
status() is O(1) in queue depth — safe to call on a metrics scrape path. (Queue age is read from an enqueue-ordered index, not by scanning the queue.)
isAvailable(): boolean
Returns true if the semaphore is not shut down, the circuit is not open, and a permit is available.
queueLength: number
Current number of tasks waiting for a permit.
availablePermits: number
Number of permits not currently held.
⚙️ Configuration reference
queueMaxLength | number | 1024 | Max tasks that may wait in the queue; further acquires reject with QUEUE_FULL. Positive integer; pass Number.MAX_SAFE_INTEGER for an effectively unbounded queue |
queueMaxTimeout | number | 10000 | ms a queued task waits before TIMEOUT |
queueMaxAge | number | 30000 | ms before the purge interval ejects a task regardless of its own timeout |
rejectOnFull | boolean | false | Reject immediately when all permits are held (no queuing) |
circuitBreakerThreshold | number | 0.5 | Failure rate in (0,1) that trips the circuit |
circuitBreakerWindow | number | 10000 | Sliding window size in ms for the failure rate. Min: 1000 |
circuitBreakerCooldown | number | 5000 | ms the circuit stays open before allowing a probe. Min: 1000 |
circuitBreakerMinThroughput | number | 10 | Min requests in window before circuit can trip |
circuitBreakerMinFailures | number | 5 | Min failures in window before circuit can trip |
backoffInitialTimeout | number | 50 | Initial backoff delay (ms) applied to scheduler wakeup on first timeout |
backoffMaxTimeout | number | 2000 | Max backoff delay (ms) applied to scheduler wakeup |
backoffDecayFactor | number | 0.5 | Backoff decay factor per idle second, in (0,1) |
purgeIntervalMs | number | 3000 | ms between stale-task purge sweeps. Min: 500 |
metricsEnabled | boolean | true | Enable windowed metrics collection |
queueOrder | 'fifo' | 'lifo' | 'fifoWithPriority' | 'lifoWithPriority' | 'fifoWithPriority' | Queue dispatch order. fifo/lifo order purely by enqueue time; the *WithPriority variants make priority primary and break ties by enqueue time. See Choosing an ordering. Ignored if comparator is set |
comparator | (a, b) => number | — | Custom ordering over queued tasks (lower sorts/dispatches first); overrides queueOrder |
debug | boolean | false | Enable debug logging and the permit-pool invariant check. Does not gate events — all events fire regardless |
Every option is optional. The object below is the complete set of defaults — copy it and change only what you need:
import { Semaphore, type SemaphoreConfig } from 'regulo';
const config: SemaphoreConfig = {
queueMaxLength: 1024,
queueMaxTimeout: 10000,
queueMaxAge: 30000,
rejectOnFull: false,
circuitBreakerThreshold: 0.5,
circuitBreakerWindow: 10000,
circuitBreakerCooldown: 5000,
circuitBreakerMinThroughput: 10,
circuitBreakerMinFailures: 5,
backoffInitialTimeout: 50,
backoffMaxTimeout: 2000,
backoffDecayFactor: 0.5,
purgeIntervalMs: 3000,
metricsEnabled: true,
debug: false,
queueOrder: 'fifoWithPriority',
};
const semaphore = new Semaphore(10, config);
⇄ Events reference
Listen with Semaphore.on(SemaphoreEvents.CIRCUITOPEN, handler).
TASKACQUIRE | 'task-acquire' | { queued, running, probe? } |
TASKRELEASE | 'task-release' | { queued, running } |
TASKTIMEOUT | 'task-timeout' | { queueLength, backoffDelay, taskId } |
TASKABORT | 'task-abort' | none |
QUEUEPURGE | 'queue-purge' | QueuedTask |
CIRCUITOPEN | 'circuit-open' | { timeoutRate, recentTimeouts, total, reason? } |
CIRCUITHALFOPEN | 'circuit-half-open' | none |
CIRCUITCLOSE | 'circuit-close' | none |
SHUTDOWN | 'shutdown' | reason: string |
🚨 Error codes
All rejections are SemaphoreError instances with a code property.
CIRCUIT_OPEN | Circuit breaker is open |
CIRCUIT_HALF_OPEN | Circuit is half-open and a probe is already in flight |
INVALID_WEIGHT | weight is not an integer in 1..count |
INVALID_PRIORITY | priority is not a finite number |
QUEUE_FULL | rejectOnFull is true, or queueMaxLength is exceeded |
TIMEOUT | Task waited longer than queueMaxTimeout; or drain() exceeded its deadline |
ABORTED | Caller's AbortSignal fired |
CANCELLED | Task was rejected by cancel() |
SHUTDOWN | shutdown() or reset() was called while the task was queued |
PURGED | Task was ejected by the stale-task purge interval (queueMaxAge exceeded) |
import { Semaphore, SemaphoreError } from 'regulo';
const semaphore = new Semaphore(10);
try {
const release = await semaphore.acquire();
release();
} catch (error) {
if (error instanceof SemaphoreError) {
switch (error.code) {
case 'CIRCUIT_OPEN':
case 'TIMEOUT':
case 'ABORTED':
}
}
}
status() output
{
status: {
running: number,
queued: number,
available: number,
inFlight: number,
pendingReleases: number,
circuitOpen: boolean,
circuitHalfOpen: boolean,
backoffDelay: number,
requestsPerSecond: number,
timeoutRate1m: number,
queueAge: number,
},
lifetime: {
totalAcquired: number,
totalReleased: number,
totalTimeouts: number,
circuitBreakerCooldownRemaining: number,
},
metrics: SemaphoreMetricsSnapshot | null
}
🔌 Standalone CircuitBreaker
CircuitBreaker can be used independently — e.g. to wrap an HTTP client. Unlike the semaphore's saturation breaker, here you decide what counts as a failure by calling recordTimeout() on whatever signal you choose:
import { CircuitBreaker } from 'regulo';
const circuitBreaker = new CircuitBreaker({
threshold: 0.5,
window: 10000,
cooldown: 5000,
minThroughput: 10,
minFailures: 5,
});
async function fetch(url: string) {
if (circuitBreaker.checkAndTransition()) {
console.log('Circuit entering half-open');
}
if (circuitBreaker.isOpen) throw new Error(`Circuit open, retry in ${circuitBreaker.cooldownRemaining}ms`);
circuitBreaker.trackAttempt();
try {
const result = await httpClient.get(url);
if (circuitBreaker.isHalfOpen) circuitBreaker.handleProbeSuccess();
return result;
} catch (error) {
circuitBreaker.recordTimeout();
if (circuitBreaker.isHalfOpen) circuitBreaker.handleProbeFailure();
else circuitBreaker.evaluateAndTrip();
throw error;
}
}
⚡ Benchmarks
Full, reproducible benchmarks live in benchmarks/ — run them
yourself with npm run benchmark:all. Figures below are from a real run on
Node v22.16.0, darwin x64, mid-2018 Intel i9 Macbook Pro; your numbers will differ — re-run locally. Each
library from How it compares is benchmarked only on the
axis it actually shares with Regulo: the concurrency limiters on capping
concurrency, the circuit breakers on per-call overhead.
🔥 Fast path, uncontended
tryAcquire + release | 2.02M | 2.34x slower |
tryAcquire + release (no metrics) | 4.73M | fastest |
use() round-trip | 1.03M | 4.61x slower |
use() round-trip (no metrics) | 1.59M | 2.98x slower |
🎛️ Weighted acquire, uncontended
use() weight=1 | 988.8k | 1.03x slower |
use() weight=4 | 1.02M | 1.00x slower |
use() weight=16 | 1.02M | fastest |
Weighted permits add no meaningful overhead regardless of weight — claiming
16 burners at once costs about the same as claiming one.
⏳ Contended throughput (tasks/sec)
| concurrency=4 | 427.1k | 1.13x slower |
| concurrency=16 | 482.5k | fastest |
| concurrency=64 | 476.1k | 1.01x slower |
| concurrency=16, random priority | 411.0k | 1.17x slower |
📈 status() snapshot cost
| 0 | 701.2k | 1.00x slower |
| 100 | 704.5k | fastest |
| 1000 | 694.9k | 1.01x slower |
status() is O(1) in queue depth — the cost is flat across queue depths (within
run-to-run noise) because queue age is read from an enqueue-ordered index rather
than by cloning and scanning the queue. Earlier releases were O(N) here; that
cost is gone, so status() is safe to call on a metrics scrape path even with
thousands of tasks queued.
📊 regulo vs. other libraries — uncontended round-trip
| cockatiel (bulkhead) | 3.73M | fastest |
| p-queue | 1.12M | 3.33x slower |
| p-limit | 1.10M | 3.38x slower |
| regulo (no metrics) | 1.48M | 2.52x slower |
| regulo | 986.6k | 3.78x slower |
📊 regulo vs. other libraries — contended throughput @ concurrency=16 (tasks/sec)
| cockatiel (bulkhead) | 1.85M | fastest |
| p-queue | 995.7k | 1.86x slower |
| p-limit | 871.2k | 2.12x slower |
| regulo (no metrics) | 546.2k | 3.39x slower |
| regulo | 450.4k | 4.11x slower |
🛡️ Circuit breaker overhead — closed/healthy circuit
regulo CircuitBreaker | 3.47M | fastest |
| cockatiel (circuitBreaker) | 2.50M | 1.39x slower |
| opossum | 1.49M | 2.32x slower |
The picture is consistent. Cockatiel's bulkhead is the fastest limiter — and
Regulo trades raw limiter throughput for an integrated priority heap, weighted
permits, a saturation breaker, and (by default) windowed metrics in one component.
On the breaker axis that integration goes the other way: Regulo's standalone
CircuitBreaker is the fastest of the three, because it defers failure
accounting to an explicit timeout signal instead of bookkeeping a rolling
window on every call.
In practice none of this is the bottleneck. Regulo guards work that is far
more expensive than the limiter itself: SSR renders, database queries,
downstream API calls, measured in milliseconds. Even at ~500k tasks/sec
under contention the per-task overhead is a few microseconds against operations
thousands of times slower. If you only need a bare concurrency cap on cheap
work in a hot loop, reach for a leaner limiter; see How it compares.
🧪 Test coverage
npx vitest run --coverage
✓ test/queue.test.ts (7 tests)
✓ test/metrics.test.ts (18 tests)
✓ test/breaker.test.ts (21 tests)
✓ test/permit.test.ts (14 tests)
✓ test/backoff.test.ts (6 tests)
✓ test/ordering.test.ts (13 tests)
✓ test/heap.test.ts (8 tests)
✓ test/list.test.ts (8 tests)
✓ test/semaphore.test.ts (90 tests)
Test Files 9 passed (9)
Tests 185 passed (185)
⚠️ Caveats
Before you crank the dial, know where the edges are:
- One
Semaphore is one failure domain. The circuit breaker and adaptive backoff are per-instance and shared across everything routed through it, so a saturation event on one dependency trips the breaker for all work in that instance. Don't multiplex unrelated downstreams or task types through a single Semaphore (and don't use weight/priority to fake it) — use one Semaphore per protected resource, or one capacity pool plus a standalone CircuitBreaker per downstream key. See Choosing an ordering.
- A free permit can sit idle behind a heavier head. The scheduler never dispatches past a head that doesn't fit, so under weighted permits one heavy task at the head can stall throughput even when there's capacity for the lighter tasks behind it. This is by design (it stops light work starving heavy work); how often it bites depends on your ordering — see Choosing an ordering.
drain() without a timeout can block indefinitely if a permit holder never releases. Always pass timeoutMs in graceful-shutdown paths.
- The circuit breaker is a saturation breaker. It trips on queue-acquisition timeouts, not on errors thrown by your operation. See How the circuit breaker works.
📜 License
MIT