tigerbeetle-node - npm Package Versions

published 0.16.16 • last week

Changelog

TigerBeetle 0.16.16

Released: 2024-12-02

The highlight of today's release is the new official Python client, implemented in #2527, and #2487. Please kick the tires!

Safety And Performance

#2517

Require that all replicas in a cluster have the latest TigerBeetle binary as a precondition for an upgrade.
#2506

Fix several bugs when handling misdirected writes. That is, situations when the disk reports a write as successful, despite the write ending up in the wrong place on the disk!
#2478

Make sure that TigerBeetle memory is not swappable, otherwise a storage fault can occur in a currently swapped-out page, circumventing TigerBeetle guarantees.
#2522

REPL correctly emits errors when several objects are used as an argument of an operation that only works for a single object, like get_account_transfers.
#2502

Add randomized integration tests for the Java client.

Features

#2527, #2487

The Python client!

Internals

#2526

Ignore OOM failures during fuzzing. Fuzzers normally don't use that much memory, but, depending on random parameters selected by swarm testing, there are big outliers. If all concurrent fuzzers hit a seed that requires a lot of memory, a fuzzing machine runs out of physical RAM. Handle such errors and don't treat them as fuzzing failures.
#2510

Track the number of untriaged issues on DevHub.

TigerTracks 🎧

Always Look On The Bright Side of Life

0.16.15

published 0.16.15 • last week

0.16.14

published 0.16.14 • 2 weeks ago

Changelog

TigerBeetle 0.16.14

Released: 2024-11-25

Safety And Performance

#2501

Call DetachCurrentThread when the Java client is closed. The underlying Zig TigerBeetle client runs in a separate thread internally, and a handler to this thread was being leaked.

This is not noticeable in normal operation, but could impact long running processes that create and close clients frequently.
#2492

Document that it's not possible to currently look up or query more than a full batch of accounts atomically without using the history flag and querying balances.
#2434

Add the ability to check timestamp order - and verify they are monotonically increasing - for accounts and transfers inside Vortex.

Internals

#2455

Recently the VOPR has gotten too good, and it's very tempting to switch to an empirical mode of coding: write some code and let the VOPR figure out whether it is correct or not.

This is suboptimal - silence of the VOPR doesn't guarantee total absence of bugs and safety comes in layers and cross checks. Just formal or informal reasoning is not enough, we need both.

Document this in TigerStyle.
#2472

Previously, the Zig part of languages clients logged directly to stderr using Zig's std.log, but since directly outputting to stderr is considered rude for a library, logging was disabled.

This PR adds in scaffolding for sending these logs to the client language to be handled there, tying in with native log libraries (eg, Log4j). No languages use it yet, however.

Additionally, log warn and err directly to stderr, if there's no handler.

TigerTracks 🎧

Hello

0.16.13

published 0.16.13 • 3 weeks ago

Changelog

TigerBeetle 0.16.13

Released: 2024-11-18

Safety And Performance

#2461

Fix a broken assert when a recently-state-synced replica that has not completed journal repair receives an old commit message.
#2474

Retry EAGAIN on (disk) reads. This is essential for running TigerBeetle on XFS, since XFS returns EAGAIN unexpectedly.
#2476

Fix a message bus crash when a client reconnects to a replica without the replica receiving a disconnect for the first connection.
#2475

Save 256KiB of RAM by not having a prefetch cache for historical balances. (Historical balances are never prefetched, so this cache was unused.)
#2482

Update hardware requirements in the documentation to include the recommended network bandwidth, advice for very large data files, and farther emphasis on the importance of ECC RAM.
#2484

Don't panic the client when the client's session is evicted. Instead, report an error any time a new batch is submitted to the evicted client. (How the error is reported depends on the client language – e.g. Java throws an exception, whereas Node.js rejects the Promise).

Note that if running clients are evicted, that typically indicates that there are too many clients running – check out the suggested system architecture.

Features

#2464

Add REPL interactivity. Also change the REPL from dynamic to static allocation. Thanks @wpaulino!

Internals

#2481

Expose the VSR timestamp to the client. (This is an experimental feature which will be removed soon – don't use this!)

TigerTracks 🎧

Olympic Airways

0.16.12

published 0.16.12 • 4 weeks ago

Changelog

TigerBeetle 0.16.12

Released: 2024-11-11

Safety And Performance

#2435

Fix an attempt to access uninitialized fields of tb_packet_t when tb_client_deinit aborts pending requests. Also add Java unit tests to reproduce the problem and validate the fix.
#2437

Fix a liveness issue where the cluster gets stuck despite sufficient durability, caused by buggy logic for cycling through faulty blocks during repair. Now, we divide the request buffer between the read_global_queue and faulty_blocks, ensuring that we always request blocks from both.

Features

#2462

Update DevHub styling.
#2424

Vortex can now not only crash replicas (by killing and restarting the process) but also stop and resume them.

Internals

#2458

Fix the Dotnet walkthrough example that misused length instead of the final index when slicing an array. Thanks @tenatus for reporting it!
#2453

Fix a CI failure caused by concurrent processes trying to create the fs_supports_direct_io probe file in the same path.
#2441

Replace curl shell invocation with Zig's http client. 😎
#2454

Properly handle "host unreachable" (EHOSTUNREACH) on Linux, instead of returning unexpected error.
#2443, #2451, #2459, #2460, #2465

Various code refactorings to improve naming conventions, readability, and organization.

TigerTracks 🎧

Scatman (Ski-ba-bop-ba-dop-bop)

TigerBeetle (unreleased)

Released: 2024-11-04

Safety And Performance

#2356

Add "Vortex" – a full-system integration test. Notably, unlike the VOPR this test suite covers the language clients.
#2430

Cancel in-flight async (Linux) IO before freeing memory. This was not an issue on the replica side, as replicas only stop when their process stops. However, clients may be closed without the process also ending. If IO is still in flight when this occurs, we must ensure that all IO is cancelled before the client's buffers are freed, to guard against a use-after-free.

This PR also fixes an unrelated assertion failure that triggered when closing a client that had already closed its socket.
#2432

On startup and after checkpoint, assert that number of blocks acquired by the free set is consistent with the number of blocks we see acquired via the manifest and checkpoint trailers.
#2436

Reject connections from unknown replicas.
#2438

Fix multiversion builds on MacOS.
#2442

On an unrecognized error code from the OS, print that error before we panic. (This was already the policy in Debug builds, but now it includes ReleaseSafe as well.)
#2444

Fix a panic involving an in-flight write to an old reply after state sync.

Internals

#2440

Expose reply timestamp from vsr.Client. (Note that this is not yet surfaced by language clients).

TigerTracks 🎧

Everything In Its Right Place

0.16.11

published 0.16.11 • last month

Changelog

TigerBeetle 0.16.11

Released: 2024-10-28

Safety And Performance

#2428

Make Grid.reserve() abort rather than returning null. When Grid.reserve() aborts, that indicates that the data file size limit would be exceeded by the reservation. We were already panicking in this case by unwrapping the result, but now it has a useful error message.
#2416

Improve availability and performance by sending start_view message earlier in the new-primary recovery – as soon as the journal headers are repaired.
#2360

Refactor compaction to clarify the scheduling logic, schedule more aggressively, and make it easier to run multiple compactions concurrently. This also improved the benchmark performance.

Features

#2425

Support multiversion (non-automatic) upgrades when the replica is started with --development or --experimental.

Internals

#2427

Allow a release's Git tag and config.process.release to differ. This simplifies the release process for hotfixes, when the Git tag is bumped but the config.process.release is unchanged.

TigerTracks 🎧

Stuck in a Timeloop

0.16.10

published 0.16.10 • 2 months ago

Changelog

TigerBeetle 0.16.10

Released: 2024-10-21

Safety And Performance

#2414

Improve performance & availability during view change by ensuring a replica only repairs the portion of the WAL that is required to become primary, instead of repairing it in its entirety.
#2412

Add a unit test for Zig's stdlib sort.

Stable sort is critical for compaction correctness. Zig stdlib does have a sort fuzz test, but it doesn't cover the presorted subarray case, and doesn't check arrays much larger than the sort algorithm's on-stack cache.
#2413

Fix a bug in the MessageBus wherein connections weren't being terminated during client teardown.

Internals

#2405

Fix a bug in the benchmark wherein the usage of --account-count-hot was broken when used in conjunction with the uniform distribution.
#2409

Revamp the core_missing_prepares liveness-mode check to correctly check for the prepares that a replica should repair (after #2414).

TigerTracks 🎧

Last Train Home

0.16.9

published 0.16.9 • 2 months ago

Changelog

TigerBeetle 0.16.9

Released: 2024-10-15

Safety And Performance

#2394, #2401

TigerBeetle clients internally batch operations for improved performance. Fix a bug where an unclosed link chain could be batched before another linked chain, causing them to be treated as one long linked chain. Additionally, prevent non-batchable requests from sharing packets entirely.
#2398

AMOUNT_MAX is used as a sentinel value for things like balancing transfers to specify moving as much as possible. Correct and fix its value in the Java client. Thanks @tKe!

Features

#2274

Improve the benchmark by adding Zipfian distributed random numbers, to better simulate realistic conditions and as a precursor to approximating YCSB.
#2393

Previously, TigerBeetle's clients disallowed empty batches locally, before the request was even sent to the cluster. However, this is actually a valid protocol message - even if it's not used by the current state machine - so allow empty batches to be sent from clients.
#2384

Revamp client documentation so that each snippet is self-contained, and standardize it across all languages.

Internals

#2404

Give the DevHub a fresh coat of paint, and fix passing seeds being blue in dark mode.
#2408, #2400, #2391, #2399, #2402, #2385

Improve VOPR logging and fix a few failing seeds.

TigerTracks 🎧

99 Luftballons

0.16.8

published 0.16.8 • 2 months ago

Changelog