@plasius/gpu-lock-free-queue

@plasius/gpu-lock-free-queue

A minimal WebGPU lock-free MPMC ring queue using a per-slot sequence counter (Vyukov-style). This is a starter implementation focused on correctness, robustness, and low overhead.

Apache-2.0. ESM + CJS builds. WGSL assets are published in dist/.

Install

npm install @plasius/gpu-lock-free-queue

Usage

import { loadQueueWgsl, queueWgslUrl } from "@plasius/gpu-lock-free-queue";

const shaderCode = await loadQueueWgsl();
// Or, fetch the WGSL file directly:
// const shaderCode = await fetch(queueWgslUrl).then((res) => res.text());

What this is

• Lock-free multi-producer, multi-consumer ring queue on the GPU.
• Uses per-slot sequence numbers to avoid ABA for slots within a 32-bit epoch.
• Fixed-size job metadata with payload offsets into a caller-managed data arena or buffer.

Buffer layout (breaking change in v0.4.0)

Bindings are:

• @binding(0) queue header: { head, tail, capacity, mask }
• @binding(1) slot array (Slot with seq, job_type, payload_offset, payload_words)
• @binding(2) input jobs (array<JobMeta> with job_type, payload_offset, payload_words)
• @binding(3) output jobs (array<JobMeta> with job_type, payload_offset, payload_words)
• @binding(4) input payloads (array<u32>, payload data referenced by input_jobs.payload_offset)
• @binding(5) output payloads (array<u32>, length job_count * output_stride)
• @binding(6) status flags (array<u32>, length job_count)
• @binding(7) params (Params with job_count, output_stride)

output_stride is the per-job output stride (u32 words) used when copying payloads into output_payloads.

Limitations

• Sequence counters are 32-bit. At extreme throughput over a long time, counters wrap and ABA can reappear. If you need true long-running safety, consider a reset protocol, sharding, or a future 64-bit atomic extension.
• Payload lifetimes are managed by the caller. Ensure payload buffers remain valid until consumers finish, or use frame-bounded arenas/generation handles.
• This demo is intentionally minimal; it is not yet integrated with a scheduler or backpressure policy.

Run the demo

WebGPU requires a secure context. Use a local server, for example:

python3 -m http.server

Then open http://localhost:8000 and check the console/output.

Build Outputs

npm run build emits dist/index.js, dist/index.cjs, and dist/queue.wgsl.

Tests

npm run test:unit
npm run test:coverage
npm run test:e2e

Development Checks

npm run lint
npm run typecheck
npm run test:coverage
npm run build
npm run pack:check

Files

• demo/index.html: Loads the demo.
• demo/main.js: WebGPU setup, enqueue/dequeue test, FFT spectrogram, and randomness heuristics.
• src/queue.wgsl: Lock-free queue implementation.
• src/index.js: Package entry point for loading the WGSL file.

Payload shape

Payloads are variable-length chunks stored in a caller-managed buffer. Each job specifies job_type, payload_offset, and payload_words in input_jobs; dequeue copies payloads from input_payloads into output_payloads using output_stride and mirrors the metadata into output_jobs. If you need f32, store bitcast<u32>(value) and reinterpret on the consumer side.