The Tinybird command-line tool allows you to use all the Tinybird functionality directly from the command line. Additionally, it includes several functions to create and manage data projects easily.
5.17.0
Added internal changes5.16.0
Added support for organizations on tb workspace createAdded support for Python 3.13Updated dependencies:
5.15.1
Fixed unsupported operand type(s) for |: 'type' and '_GenericAlias bug that was causing the CLI to fail when using Python 3.9 in some cases.Added support for s3_iamrole as service type for S3 Data Sources on tb datasource sync.5.15.0
Removed Snowflake connector command from tb connection create.5.14.0
Added support for KAFKA_KEY_FORMAT and KAFKA_VALUE_FORMAT parameters for kafka datasources.5.13.3
Fixed updating the cron schedule of a BigQuery data source when having a query but no external_data_source setting.Fixed handle Kafka connector with multiple brokers properly.5.13.2
Fixed Correctly handle Kafka connector with multiple brokers5.13.1.dev2
Added comply with PEP 625Added eu-west-1 region to the list of available regions.5.13.1
Added support for EXPORT_WRITE_STRATEGY parameter for sinks, in .pipe files.Changed environment variables are now evaluated in the SQL nodes.5.13.0
Added additional metadata to tb branch ls commandChanged dependencies to be less restrictive:
>=41.0.0 to ~=41.0.0==3.12.3 to ~=3.12.35.12.0
Added support for KAFKA_SASL_MECHANISM in .datasource files.Changed Upgrade clickhouse-toolset to 0.33.dev0 to support new ClickHouse JSON type.Changed multiple dependencies:
>=3.4.8 to >=41.0.0==3.1.32 to ~=3.1.32==8.2 to ~=8.2==2.5.2 to ~=2.8.0==6.0.0 to ~=6.0.0==2.7.1 to ==3.12.35.11.0
Changed Drop support for Python 3.85.10.2
Changed Bump tinybird-cli version in requirements.txt when running tb init --gitChanged Use aiofiles for async operationsFixed TAGS format was missing quotes in `tb pull``Fixed some internal typing issues from the CLI. Something internal that we don't include in the changelog of the CLI.5.10.1
Fixed Internal Error while pushing S3 Data Source which provided the wrong cron expression to the backend.5.10.0
Added support for Kafka Data Sources with CA certificate.Fixed Correctly parse lambda expressions in indexesChanged Upgrade clickhouse-toolset to 0.32.dev0Added new "File not found" error to tb check when including files from missing paths.Added support for Kafka Data Sources with CA certificate.Changed Upgrade clickhouse-toolset to 0.32.dev0Fixed Correctly parse lambda expressions in indexes5.9.0
Added tb pull has a new --fmt flag to apply the same formatting as tb fmt when pulling a datafile.Changed tb auth info and tb auth ls now show the region API host properly.Removed misleading output message when tb auth --token with TB_TOKEN env var also defined.Fixed error messages when performing operations without being authenticated or using a token.Fixed tb auth uses explicitly the --host if provided.5.8.1
Improved error message of tb push when pushing .datasource files.5.8.0
Added tb datasource scheduling commands to manage the scheduling of a Data SourceAdded tb tag commands to manage tags from the CLI.Added support to TAGS in tb fmt.Added support to TAGS in tb pull and tb push. Allows tagging resources for filtering in the UI.5.7.0
Changed support prod as main git branch name when running tb init --gitFixed issue with tb auth ignoring the token value when using --region and --token options together.Fixed tb auth not getting the proper value when using the TB_TOKEN env var.5.6.0
Added Add IMPORT_FROM_TIMESTAMP to the list of supported directives in the CLI for S3 Data Sources, files added to the S3 bucket before that time will be ignored. Read our docs for more information.Fixed region list for AWS and custom regions when usign tb auth --interactive5.5.0
Added Support gte and lte in sql_and directive. See https://www.tinybird.co/docs/cli/advanced-templates#sql-andChanged info and error messages when using "user token" vs "admin your@email.com" tokenFixed regions list when usign tb auth --interactive, tb auth ls and tb auth info5.4.0
Added support to Python 3.12Added support to Stream Pipes in tb push and tb pull commands. (Feature in development. It requires access)Added json and jsonl as supported formats for S3 Data SourcesChanged tb init --git now supports run from a develop branch in gitFixed Do not try to deploy shared Datafiles from the vendor folder on tb deploy5.3.0
Added tb push now supports dynamodb as service typeAdded tb connection create now supports dynamodb as service typeAdded error when trying to push a data source with SETTINGS instead of ENGINE_SETTINGSAdded support for buckets with gzip files when creating S3 Data Sources5.2.1
Added tb push prevents pushing pipes that have nodes with the same name as the pipe.Changed helper messages to rename Token to Static TokenFixed error messages when using tb push with already taken names for other resources.5.2.0
Added internal changesAdded tb pipe unlink commandChanged No need for --node param in tb pipe populate5.1.0
Added COPY pipes now support COPY_MODE replace.Added improve checks for dependencies in pipes when altering Data Sources.5.0.0
Breaking change Make insertion_date column explicit. This column is no longer inferred, it must be present in the Data Source file.
Detailed info at https://www.tinybird.co/docs/changelog/2024-06-17-insertion_date-deprecation
Added parameter to tb pipe regression-test --relative-change
Added tb push displays warnings when using a reserved parameter in a pipe.
Added --role parameter to tb workspace members add
Changed Point region hosts to new app.tinybird.co domain
Improved help message of tb workspace members set-role now displays the 3 valid roles: viewer|guest|admin.
Improved syntax error messages when parsing endpoints.
4.1.1
Fixed workspace info gathering when switching branches. We were prioritizing the general workspace properties over the user ones.4.1.0
Added tb token create command to be able to create static and JWT tokens from the CLI. You can check more information at https://www.tinybird.co/blog-posts/jwt-api-endpoints-public-betaFixed tb init --git to pin tinybird-cli>=4,<5 in requirements.txt to avoid issues with the latest version of the CLI.4.0.0
This is a major release, please read the commands affected below and consider updating your scripts and workflow before upgrading to this version.
Deprecated --semver flag and tb release commands are now deprecated. You can keep using tb deploy to integrate and deploy from git. Changes are deployed to the main Workspace instead of to a Release.Removed --cicd flag and CI/CD templates generation from tb init. You can still use the git integration, just create your own pipelines. You can use the ones in this repo as an example https://github.com/tinybirdco/ciRemoved tb env command is removed, use tb branch instead.Deprecated .datasource files with ENGINE "Join" is deprecated, use Engine "MergeeTree" instead.Deprecated tb materializeRemoved Drop the --timeout flag from tb push which made the populate job to timeout. You can use now --wait to wait for the job to finish or nothing to just create the job and return.Removed Support for KEY directive is removed. The KEY was used to create a Data Source with Join engine by the given KEY column name. Join engines are also deprecated, you can use a regular MergeTree Data Source instead and adapt the pipes SQL accordingly.3.12.0
Added new "us-west-2" region to tb auth lsFixed "Appended 0 new rows" message when appending NDJSON3.11.0
Added confirmation step to tb datasource sync commandFixed support for KAFKA_STORE_BINARY_HEADERS for new Data Sources. Only relevant when KAFKA_STORE_HEADERS is also enabled, used to store Kafka headers as binary data (default option from now on).Fixed Report error when tb push --force --yes cannot apply a change in a .datasource schemaFixed Skip error when using tb push --only-changes and no local .git directory is present3.10.0
Added support for unlink materialized pipes doing tb workspace clearAdded support for adding multiple tokens when pushing a .datasource fileFixed s3 iamrole connection creation will not fail when pbcopy dependency is not availableFixed Fixed a bug on data branchingFixed Support ngram index3.9.0
Added Support for connection names when doing tb connection rmAdded New --policy option for create s3_iamrole command that will generate different hints depending on the caseFixed Avoid system vars evaluation when doing tb fmtFixed environment variables substitution for Data Source engine parameters.3.8.0
Added Support for S3IAM role for ingestChanged Upgrade clickhouse-toolset to 0.30dev0Changed Decouple cli from connector_settings module3.7.0
Changed fixed major version of tinybird-cli to lower than 4 when using tb init --gitChanged behavior when running tb deploy on a branch to push the connection settings to the backend. This change is the backend that decides what to do.Changed tb pipe sink commands are now availableFixed regression tests query when filtering by specific parameterFixed Avoid tb fmt to error if there's a CASE in the sqlFixed Some issues when using --fmt: off with CASE in the sqlFixed tb deploy supports deployment when a .incl file is removedFixed Report better error message on tb diff when two Datafiles have the same nameFixed Added correct URL for checking available regionsFixed Support .incl files with environment variables in tb fmt3.6.0
Added Add new envvar TB_INCL_RELATIVE_PATH in .tinyenv to look for Datafiles out of the Data Project directoryChanged On-demand Sink run checks the pipe type instead of checking the workspace connectors3.5.0
Added Token management in Copy pipes datafilesAdded Better error report on tb push when trying to push a pipe with bad templatingAdded credential validation for S3 connectionsAdded tb connection create now supports s3_iamrole as service typeChanged error message when trying to modify a datasource without bumping the major semver version to add a link to the documentation.Changed GH workflow files and secret includes the workspace name when generated from the UI and CLIChanged rename INDICES to INDEXESChanged Save git commit to workspace on tb push --only-changesFixed Fix error message when deleting an .incl file with the git workflowFixed support tb deploy --dry-run3.4.0
Added Support tb deploy .datasource with INDEXESAdded Support tb push .datasource with INDEXESAdded Support tb deploy in a post release of a .datasource with INDEXESAdded Check backfill on preview is required when tb deploy modified datasources. Disable check with TB_CHECK_BACKFILL_REQUIRED=0.Changed Allow spaces when managing multiple Workspace membersChanged tb deploy to not allow pushing materialized views with datasource definition in the same datafile. We are blocking this as has unsupported behavior and it misleading and less flexible than having 2 files one for the datasource and one for the materialized view.Changed tb deploy to deploy the datasources from top to bottom to make sure that if we modified the column in some datasource in the top. It will be deployed before the datasources that depend on it.Changed Post-release required when deploying changes that include changing a Copy Pipe.Changed script exec_test.sh from tb init --git to run retries to avoid flakiness in testsChanged Update tb release rm --oldest-rollback to use new APIFixed Post-release recommended instead of required when deploying changes that include changing a Copy Pipe. Displays a warning when other number of the semver is increased.Fixed Fixed bug when a Data Source was created using an INDEXFixed Avoid None git diff change typeFixed tb deploy to deploy the endpoints in the correct order when there are endpoints depending on other endpoints.Fixed tb push pipe with multiple tokensFixed IMPORT and ENGINE changes were not detected tb deployRemoved part of the code supporting python 3.6 as we stopped giving support 18 month ago3.3.0
Added Show warning when doing data or pipe operations directly against Live.Added bi_stats, bi_stats_rt and endpoint_errors to the list of service data sources that the CLI ignore when looking for dependencies of pipes being pushed.Added S3 Iam Role connection creationAdded Connector credential validationAdded Data quality tests inside a skip_in_branch folder inside the tests folder are skipped when running on a branch. Use this to skip tests in the CI piipeline that should only run with production data.Changed Stop creating endpoints folder on tb initChanged Small refactoring of the connector credentialsFixed Progress bar in tb init --git.Fixed Don't do diff when there are no modified resources on tb deploy.Fixed Upgrade GitPython dependency to 3.1.32. That version fixes the security vulnerability CVE-2022-24439 <https://github.com/advisories/GHSA-hcpj-qp55-gfph>Fixed Homepage URL in PyPI3.2.0
Changed tb init --git uses v3.1.0 of the CI templates (See release notes: https://github.com/tinybirdco/ci/releases/tag/v3.1.0)Changed Allow alter data source with JSON paths to add DEFAULTS if the data source already has any (See release notes: https://github.com/tinybirdco/ci/releases/tag/v3.1.0)3.1.0
Added tb init --cicd to generate CI/CD files not only when using --git. Combine with --force to overwriteAdded Ignore format changes on tb deploy by defaultChanged tb init --git and tb release generate include set -euxo pipefail in the generated bash scriptsChanged tb init --git uses github.com/tinybirdco/ci => v3.0.0Changed Internal changes to allow parametrize fmtChanged tb release promote automatically deletes de oldest rollback Release if export TB_FORCE_REMOVE_OLDEST_ROLLBACK=1Changed option --node in tb pipe populate to required as it is already mandatory to specify the node to populate. Now, it will provide an error message if the --node option is not provided.Changed Better error report on tb fmt --diff. Use it in CI to standardize Datafile formattingChanged tb init --git generates a requirements.txt file to install the latest tinybird-cli release from PyPIChanged tb deploy shows an example when failing because of a missing --semver argumentFixed When parsing the response of a CSV tb sql command, the CLI was interpreting the result as an error in some cases.3.0.0
Major version updated to 3.0.0 due to the change in the logic of tb deploy. From this version on, tb deploy promotes Releases to Live or Preview based on the semver version.
See our Version Control guides <https://www.tinybird.co/docs/version-control/deployment-strategies.html#semver-deployment-behaviour>_ for more details about our semver deployment behaviour.
Added syncing status to git remote settingsAdded tb release rm --oldest-rollback --force --yes deletes the oldest rollback Release by creation dateChanged Updated logic in tb deployChanged Updated scripts/exec_test.sh generated from tb init --gitChanged Pointing to versions.tinybird.co for docs pages related to VersionsChanged Initial git files to include mandatory directoriesChanged Unify generation of ci/cd script resourcesChanged Update clickhouse-toolset to 0.29.dev0Changed When removing a Release, the CLI will now inform if Share Data Sources are still being used in a Materialized View in other Workspaces.Changed Update CLI to generate ci/cd resources: new append_fixtures.sh and updated exec_tests.shChanged Update tb release generate to generate deploy.sh and postdeploy.sh with instructions on how they workChanged .tinyenv default template includes all possible varsChanged behaviour of tb env regression-test when no requests are found. Now, it will show a warning message and will not fail the command.Changed Add usage validation on tb release rm and allow --force to avoid the validationChanged Support raw content on datafile parsesFixed tb deploy now fails with exit 1 in case a release limit has been reached.Fixed tb deploy validates post --semverFixed append_fixtures.sh script to exit with 1 when there's an errorFixed Error while pushing Sink Pipes using IAM Role Connector for S3Fixed Deploy pipes with shared Data Sources using tb deployFixed Bug on tb deploy which did not preserve a proper order when deploying resourcesFixed Small error message misspell. The argument to use the User token in certain operations like sharing a Data Source is --user_token and was written as --user-token.Removed --all argument from tb branch2.2.0
Changed tb init --git update to get ready to use cicd with releasesChanged Use tb branch instead of tb env. tb env is still usable but deprecated and will be removed in the next version.Fixed command tb pipe regression-tests to handle the edge case when all the requests to the endpoint that we want to check fails as the value returned is no what we expect.Fixed tb deploy fixes to work with --dry-run and push changes of new and modified filesFixed tb check doesn't exit with error when checking a .incl file.Fixed tb fmt adds empty quoted strings in .datasource connection section.Fixed Be smarter in tb fmt when detecting if .incl file contains Data Source or Pipe definitions.Fixed tb env use when using a token directly, without a .tinyb file.2.1.0
Changed exec_test.sh now runs with parallel -j 4 to speed up CI cyclesChanged tb release rollback now requires double confirmationFixed Ignore .diff_tmp/ on tb deployChanged Regression tests select faster the requests used for the checks.Improve peformance when using the option --only-change in the tb push command. This was a regression introduced in the version 2.0.0Added Add option c or --concurrency to tb run test to run tests in parallelRemoved hidden option --only-changes from tb deploy as it's no longer required.Changed Speed-up CLI startup by lazy-importing some dependencies.Added tb auth shows and uses the new AWS regionsAdded Add --auto-promote to tb deploy to automatically promote the Release created. It automatically applies to Environments created by CI.Added Support TAGS "backfil_column=<column_name>" in .datasource definition to do backfill operations when running a populate jobChanged Regression tests now also use Pipe requests done with the POST HTTP method.Changed tb env commands to use the new CLIConfig class to manage the authentication and the configuration of the CLI. This change allows us to have a better control of the configuration and the authentication of the CLI. This should be transparent for the users.Changed Internal changes in tb deployAdded tb deploy removes resources from datafiles deleted2.0.0
Released new version 2.0.0 with all these changes:
Changed All commands exit with 1 when there's an exceptionRemoved Prefixes are not supported anymore (context, and how to migrate)Removed tb pipe create1.3.0
Released new version 1.3.0 with all these changes:
Added Support for Copy pipes in tb fmtAdded Support for .datasource.incl files in tb fmtFixed tb auth use to move between regions saved in the config fileFixed Skip regression.yaml in tb test run since it's reserved for regression testsFixed Skip replacing .incl files in tb fmt1.2.0
Released new version 1.2.0 with all these changes:
Changed Upgrade CICD version templates for tb init --gitChanged Support tb release commands in EnvironmentsFixed Correct paths for triggering CICD generated by tb init --gitFixed rolled back the version of the snowflake-connectors-python package.Fixed Do not print data branching summary in tb env create <env_name>1.1.0
Released new version 1.1.0 with all these changes:
Added Support skip individual regression tests through the regression.yaml configuration file. CI/CD guide at https://www.tinybird.co/docs/guides/continuous-integration.htmlAdded Fail tb env regression-tests if no tests are run for any pipe, use skip to avoid the errorAdded Skip POST requests by default in tb env regression-tests until it's supportedAdded Support append --fixtures to shared Data Sources in EnvironmentsAdded support --assert-max-time in tb env regression-tests so that serves as threshold for response time and avoid flakiness on fast endpoints.Added support tb env regression-tests --main -f regression.yaml so you can run regression tests agains the main Environment together with a configuration file.Added tb env regression-tests coverage --main runs coverage regression tests in the main Environment. This command is experimental and undocumented.Changed tb init --git --folder <folder> includes the <folder> in the CI/CD templates as data_project_dir and in the paths to track changes so CI and CD only run when there's a change on that folder. If <folder> is not provided then it is set to the current directory .Changed Force tb init --git to run in the main or master git branchChanged the creation of the CD/CI workflow when running tb init --git to use the admin workspace token instead of the token of your admin user.Changed Expose resources and ids when removing releases tb release rmChanged --override-commit option to not require needing to pass the --git option as well. Now, running tb init --override-commit should work as expected.Changed Copy and Sink on-demand jobs now return the job URL.Changed allow Workspace admin tokens for CI/CD workflows. Previously, you were asked for user admin token. You can update your TB_ADMIN_TOKEN to be the Workspace admin token instead the admin token from a specific user. CI/CD guide at https://www.tinybird.co/docs/guides/continuous-integration.htmlChanged Improve CI/CD output. Added warning hint in custom deployments.Fixed tb deploy raises an error if it detects resources renamed in gitFixed On tb push --force --yes a BigQuery Data Source, it updates both the SCHEMA and connector settings.Fixed Connection settings of BigQuery Data Sources are preserved in Environments, although the connection does not sync by design, to ingest data use --fixturesRemoved warning message that recommended not using the admin token for CI/CD workflows as we introduced a fix in the version 1.0.1 to avoid the problems that the admin token was causing.Removed fallback when running tb pipe regression-test does was doing requests to /v0/pipes/XXX/requests as it was mostly not used. This endpoint was being called when there weren't requests in tinybird.pipe_stats_rt in the last 7 days. This endpoint was really heavy and most of the time wouldn't return any actual data as endpoint not being called after 7 days most likely are not in production.Removed async parameter in the /v0/environments requests as it's not being used.1.0.1
Released new version 1.0.1 with all these changes:
Added Google Cloud Storage as a Data Source connector (BETA)Added support for fixtures using Parquet format. Also, we have modified the message when no fixture is found. Before it would show something like ** Warning: datasources/fixtures/current_events.ndjson file not found as it was the last format was looking for, now it will display ** Warning: No fixture found for the datasource current_eventsAdded tb deploy output now exposes what is detecting for deployingAdded tb env regression-tests commands now support flag --skip-regression-tests or export TB_SKIP_REGRESSION=1 to skip execution of regression tests. Handy for CI environments were regression tests might be flakyChanged tb init --git uses v2.3.0 of the CI/CD templates. See release notesChanged tb auth info to give better information in case of authentication problemsChanged When running tb init --git for the first time the exec_test.sh script to run fixtures tests now includes an environment variable export TB_VERSION_WARNING=0 to skip the CLI version warningChanged Support OBFUSCATE_REGEX_PATTERN and OBFUSCATE_PATTERN_SEPARATOR environment variables to define a regex pattern and a separator (in case of a single string with multiple regex) to obfuscate secrets in the CLI outputChanged Update clickhouse-toolset to 0.28.dev0Fixed Skip error when tb deploy --populate --wait and a copy pipe has been deployedFixed Typo when there is an error with a connectionFixed that all the HTTP requests follow the environment variable TB_DISABLE_SSL_CHECKS. This environment variable allows users to disable the SSL verification if needed. By default is not disabled. Before this version, some HTTP request were not disabling the SSL validationFixed tb env rm and tb env use when using the admin workspace token. Before when using these command and using the admin token, this command would return an error saying that the workspace was not found. Now, these commands should work as expectedFixed tb connection ls now lists BigQuery connectionsFixed tb pull and tb diff now respect multiline in IMPORT_QUERY1.0.0
Released Version 1.0.0, from now on the tinybird-cli package uses the standard semver convention for stable versions. Development versions will be tagged as with the .devX suffix where X is an integer number.1.0.0b448
Changed Better error feedback when Environment is not ready for tb deploy1.0.0b447
Added tb datasource delete new option dry-run to check number of maching rows before execute1.0.0b446
Added tb token ls to list all the available tokensAdded tb token copy to copy a token to the clipboardAdded tb token rm to remove a tokenAdded tb token refresh to refresh a tokenAdded tb token scopes to list the scopes of a token1.0.0b445
Changed tb env create waits job by default. Use --no-wait in case you wan't to avoid waiting.Changed Better error feedback for tb deploy when Environment creation is not completed1.0.0b444
Fixed: Data Sources definition: Default column modifier not allowed when there's json paths1.0.0b443
Changed Bump CI/CD release to v2.2.0 => https://github.com/tinybirdco/ci/releases/tag/v2.2.01.0.0b442
Fixed Check if not main when creating an Environment1.0.0b441
Changed tb token --git unhidden1.0.0b440
Changed tb token rm needs to be confirmed or run with --yes flag to be removed1.0.0b439
Added References to the latest release of our CI/CD actions1.0.0b438
Fixed tb diff just using progressbar in tb init --gitFixed tb env rm returns proper error when trying to remove from another EnvironmentChanged tb auth better output suggesting to use region host1.0.0b437
Fixed tb check compatility with tokens DatafilesFixed tb token rm returns proper error when token does not exists1.0.0b436
Changed Internal changes1.0.0b435
Fixed tb init --git fails if diffs detected and not executing tb pull --auto --force1.0.0b434
Changed Versions Gitlab ci/cd pipeline to ensure temporal envs are removed1.0.0b433
Addded tb deploy exposes git diff output before pushing resources.1.0.0b432
Changed multiple dependencies to be less strict:
==8.1.6 to >=8.1.6,<8.2==3.4.8 to >=3.4.8==6.0 to >=6.0,<6.1==2.28.1 to >=2.28.1,<3==1.26.14 to >=1.26.14,<21.0.0b431
Changed tb pull defaults now to --auto True, that means that it preserves the Data Project default folder structure. You can still pull all files to the current folder by using the --no-auto flag.1.0.0b430
Deprecated tb pipe new command is deprecated1.0.0b429
Changed --prefix deprecation message to indicate next EOL on 20th Dec.1.0.0b428
Added support for the new Versions feature.1.0.0b427
Changed tb pull omits insertion_date meta-column1.0.0b426
Added Commands for the new Versions feature (https://www.tinybird.co/blog-posts/git-for-real-time-data-projects).1.0.0b425
Changed Don't run regression checks on tb deploy1.0.0b424
Fixed Bug in tb env regression-tests when --no-assert-result-rows-count provided1.0.0b423
Added option to show token values in the output using the --show-tokens flag.--hide-tokens flag.1.0.0b422
Fixed Errors in the last release.1.0.0b421
Fixed Provide feedback error message for erroneous commit on 'tb deploy'1.0.0b420
Changed The way the command tb workspace connect handles connections.1.0.0b419
Fixed tb init Avoid to create example tests when tests folder already exists1.0.0b418
Added Option '--commit' to provide and force git commit reference to 'tb init --git'1.0.0b417
Fixed 'tb push' and 'tb deploy' just pushes pipe endpoints at the end when no forward deps1.0.0b416
Added tb init --git Checks that .diff_tmp is added to .gitignore. Throws an error if it's not.1.0.0b415
Changed the behaviour of tb pull, tb datasource ls and tb pipe ls to not detect the prefixes in the resources by default. In case, you want to use tb pull, tb datasource ls or tb pipe ls in the same way as before, you will need to specify which prefix you want to detect using --prefix.1.0.0b414
Fixed tb init --git unexpected error when using token not associated to user1.0.0b413
Changed Improved error outputs working with environments1.0.0b412
Changed tb init --git cicd files are generated after release is finished1.0.0b411
Added tb test pipe endpoint test example on 'tb init' data project generation1.0.0b410
Changed tb init --git order of execution to be more reliable1.0.0b409
Changed tb deploy --fixtures to append the fixtures instead of replacing the data.Fixed tb deploy --fxitures to append the fixtures even if there is no other change1.0.0b408
Deprecated Hide and deprecate warning for the --prefix flag in all commands. The prefix feature is superseded by Workspaces, use tb workspace create instead.1.0.0b407
Fixed tb token copy not working properly in Linux1.0.0b406
Fixed Fail tb init --git if there are untracked files in project paths1.0.0b405
Added Extra information about the current token and host to the tb auth info command.1.0.0b404
Fixed Command tb workspace create when running in a CI environment.1.0.0b403
Changed behaviour of tb push to only execute the SHARED_WITH logic when passing the --user_token option1.0.0b402
Fixed Pushing a token with SQL condition1.0.0b401
Changed Shows instructions snippet when creating a Snowflake connection and password not provided.1.0.0b400
Added Support SETTINGS clause in query definition. Only a few of them are enabled in the backend.1.0.0b399
Added Allow to copy data between Data Sources releases1.0.0b398
Fixed Not shared resources now go to the correct folder when doing tb pull --auto1.0.0b397
Added Experimental token management from the CLI (Feature in development. It requires access)1.0.0b396
Changed Remove S3 feature flags1.0.0b395
Added support to sink Pipes in tb push command (Feature in development. It requires access)1.0.0b393
Changed Upgrade version of generated cicd templates1.0.0b393
Fixed tb diff now shows the correct message when one of its arguments is deprecated1.0.0b392
Changed Internal changes1.0.0b391
Changed Internal changes1.0.0b390
Improve Feedback messages on tb init1.0.0b389
Changed Python 3.7 is no longer supported. The minimum supported version is now Python 3.8.1.0.0b388
Fixed tb fmt when used with include files that contains nodes that are not being used in the parent pipe1.0.0b387
Changed creation of gcs connection when creating data connector for sinks to gcs_hmac from gcs1.0.0b386
Fixed Adding a column to Kafka Data Sources with tb push -f1.0.0b385
Changed Added an 'End of support for Python 3.7 starting on 2023-08-01' notice.1.0.0b384
Fixed integration and stage are not prompted anymore when creating a Snowflake connection1.0.0b383
Fixed bug introduced in version 1.0.0b375 causing the regression-test to fail when the size of the response length was different1.0.0b382
Fix Environments minor fixes1.0.0b381
Improve feedback messages in different commands1.0.0b380
Fix small bug when trying to unshare a datasource from all the workspaces removing the SHARED_WITH entry1.0.0b379
Added S3 connector creation1.0.0b378
Added support of SHARED_WITH in tb pull and tb diff1.0.0b377
Update click package dependency from 8.1.3 to 8.1.61.0.0b376
Changed tb init now creates additional folders1.0.0b375
Changed Internal changes1.0.0b374
Fixed Overriding a pipe when changing nodes from endpoint to copy and vice versa when running tb push with the --force flag1.0.0b373
Changed Internal changes1.0.0b372
Changed Internal changes1.0.0b371
Changed Internal changes1.0.0b370
Changed Internal improvements.1.0.0b369
Changed Filter requests with environment parameters in regression tests when running tb push or tb pipe regression-test1.0.0b368
Fixed PLAIN default --sasl-mechanism value in tb connection create kafka command1.0.0b367
Changed Internal changes1.0.0b366
Fixed tb append now returns the correct message when the append is successful1.0.0b365
Fixed tb fmt removes empty space after empty comment1.0.0b364
Changed Internal changes1.0.0b363
Changed Internal changes1.0.0b362
--token parameter, refresh credentials to be able to rely on them1.0.0b361
Changed Internal changes1.0.0b360
Changed Internal changes1.0.0b359
Changed Internal changes1.0.0b358
Added Option --ignore-datasources not to attach data in environments for specified datasources1.0.0b357
Changed Internal changes1.0.0b356
Changed Internal changes1.0.0b355
Changed Filter requests with errors in regression tests when running tb push or tb pipe regression-test1.0.0b354
Fixed Allow not having git executable1.0.0b353
Changed Improve tb env regression-tests output1.0.0b352
Added tb fmt --diff which exits 1 if local and formatted files are different. Useful for CI/CD pipelines.Fixed Some fixes in tb fmt regarding empty newlines.1.0.0b351
1.0.0b350
Fixed tb fmt now formats datafiles properly when attributes are present in include1.0.0b349
Fixed Report shared Data Sources as shared on tb diff1.0.0b348
Added Copy Pipe commands1.0.0b347
Fixed Node renaming when pushing a copy pipe1.0.0b346
Fixed Message after reaching limits of a copy pipe1.0.0b345
Fixed tb pull omits the __value column in Kafka Data Sources if they are created with NDJSON formatFixed tb fmt finishes with an end line breakFixed Node renaming when pushing a copy pipe1.0.0b344
Added compatibility with ClickHouse 23.5 functions and syntax1.0.0b343
Fixed Message after pushing a copy pipe without schedule1.0.0b342
Fixed Copy schedule is deleted when cron is not present in .pipe file1.0.0b341
Fixed Error handling when copy pipes reach the maximum number of executions1.0.0b340
Added tb pipe rm <localfile.pipe> now supports a local file to a pipe file to remove it from the remote server1.0.0b339
Added Versioning support for Copy Pipes1.0.0b338
Fixed tb test run handles properly executions with errors1.0.0b337
1.0.0b336
Fixed tb pull didn't work properly when pulling the latest version of a remote resource1.0.0b335
Added integration and stage fields to Snowflake connection configuration1.0.0b334
Added tb test not supports a new pipe directive to perform data quality tests over pipes published as endpoints1.0.0b333
Added Resume/pause actions to scheduled copy pipes1.0.0b332
Fixed format ENGINE_TTL expression on tb diff to match the one in the remote server1.0.0b331
Fixed Requests to v0/tokens now send data in the body when the URI is too long1.0.0b330
Fixed tb push --push-deps to push endpoints in the correct order when there are multiple dependent endpoints1.0.0b329
Fixed A bug when pushing pipes with tokens that affected versions from 1.0.0b326 to 1.0.0b328. If you are using one of these versions, please upgrade to 1.0.0b329 and review your tokens scopes.1.0.0b328
Added Support to tb pull when the pipe has type copy1.0.0b327
Changed Requests to tb pipe data now send data in the body when the URI is too long1.0.0b326
Changed Requests to v0/tokens now send data in the body1.0.0b325
tb branch to tb env1.0.0b324
tb diff improvements. It does not diff meta columns in Kafka Data Sources or automatically added ENGINE_PARTITION_KEY.tb diff just diffs mutable attributes in a .datasource file: ENGINE_TTL, SCHEMA, TOKEN, VERSION.tb pull now downloads TOKEN with scope APPEND if the Data Source had it in the Workspace.1.0.0b323
1.0.0b322
1.0.0b321
tb pull and tb diff when a workspace has prefixed resources1.0.0b320
1.0.0b319
1.0.0b318
1.0.0b315
1.0.0b314
1.0.0b313
1.0.0b312
1.0.0b311
1.0.0b310
1.0.0b309
1.0.0b308
1.0.0b307
1.0.0b306
1.0.0b305
1.0.0b304
1.0.0b303
tb diff that made indentation not work properly1.0.0b302
1.0.0b301
1.0.0b300
1.0.0b299
1.0.0b298
1.0.0b297
SHARED_WITH, we support the option --workspace_map. This is useful if you have multiple workspaces where you replicate the same project like CI or staging environment1.0.0b296
1.0.0b295
1.0.0b294
1.0.0b293
1.0.0b292
1.0.0b291
tb push --push-deps to always push pipe endpoints the last when they are not a dependency of a Materialized Node. Fixed a bug.1.0.0b290
tb push --push-deps to always push pipe endpoints the last when they are not a dependency of a Materialized Node1.0.0b289
tb pipe regression-test to retry 3 times to avoid false alerts when comparing endpoints that have continuos ingestion1.0.0b288
1.0.0b287
1.0.0b286
1.0.0b285
tb push --user_token <USER_TOKEN> and the datafile contains the entry SHARED_WITH1.0.0b284
tb auth command fails.1.0.0b283
1.0.0b282
tb diff --no-verbose to be able to run tb diff without showing the diff output.1.0.0b281
1.0.0b280
1.0.0b279
1.0.0b278
tb connection ls command1.0.0b277
tb connection create --help command1.0.0b276
1.0.0b275
1.0.0b274
--confirm_hard_delete to be able to remove a workspace without soft delete and directly remove workspace1.0.0b273
1.0.0b272
1.0.0b271
1.0.0b270
tb test run outputs the information following a tabletb test run fails, the CLI will raise an exception to exit 11.0.0b269
1.0.0b268
tb datasource unshare to be able to unshare a datasource.1.0.0b267
1.0.0b266
1.0.0b265
1.0.0b264
tb fmt that replaced single quotes by double quotes breaking some queries1.0.0b263
1.0.0b262
1.0.0b261
tb push --fixtures1.0.0b260
-f option along --force option in tb pull/init to match tb push.1.0.0b259
urllib3 and cryptography dependencies for more reproducible installations.1.0.0b258
tb connection create bigquery command.1.0.0b257
1.0.0b256
1.0.0b255
1.0.0b254
{% if %}1.0.0b253
tb push command.1.0.0b252
1.0.0b251
tb pipe stats support formatting the result in JSON1.0.0b250
1.0.0b249
tb sql1.0.0b248
tb diff. Now it shows a message when downloading remote resources, change the remote file description and remote resources are downloaded at once.1.0.0b247
tb check supports running validation pointing to directories1.0.0b246
1.0.0b245
1.0.0b244
1.0.0b243
tb diff1.0.0b242
1.0.0b241
--pipeline to tb sql to run a SQL query that refers a node in the current --pipeline passed as an argument. See API docs.--pipe and --node to tb sql to run the SQL query of a node of a pipe.1.0.0b240
1.0.0b239
1.0.0b238
1.0.0b237
--ignore-order on tb push or tb pipe regression-test to support sorting with mix of columns with null and actual values1.0.0b236
1.0.0b235
tb diff to support VERSION, INCLUDE and diff folders, for instance, tb diff pipes1.0.0b234
1.0.0b233
tb fmt Data Sources DESCRIPTION is now included1.0.0b232
tb prompt with instructions on how to include info about the CLI in the shell PROMPT1.0.0b231
tb workspace current and tb workspace clear when working with admin workspace token.1.0.0b230
1.0.0b229
1.0.0b228
1.0.0b227
tb diff format files by default, so only changes are diffed1.0.0b226
--unlink-on-populate-error to automatically unlink a Materialized View if a populate job fails. By default Materialized Views are unlinked the first time a populate job fails. See docs for more details.1.0.0b225
tb diff command to compare local with remote files1.0.0b224
1.0.0b223
1.0.0b222
tb push --fixtures1.0.0b221
1.0.0b220
1.0.0b219
1.0.0b218
1.0.0b217
1.0.0b216
1.0.0b215
1.0.0b214
tb create workspace help, it explains what --user_token does1.0.0b213
tb fmt with files that have VERSION 01.0.0b212
tb pipe data --format json ...1.0.0b211
1.0.0b210
1.0.0b209
1.0.0b208
.incl files when running tb push as they are included files that shouldn't need to be pushed1.0.0b207
1.0.0b206
1.0.0b205
1.0.0b204
tb test run <file> --fail to show only failed tests.1.0.0b203
tb pipe append.1.0.0b202
tb auth --host XXXX, we strip the host parameter to keep just the domain (https://XXXX.tinybird.co)1.0.0b201
workspace_map replacements, making it more flexible, and less prone to errors.1.0.0b200
tb test suite, now reduced to tb test [init,run,parse], simplified the tests, and based in the YAML format.1.0.0b199
tb datasource append.1.0.0b198
1.0.0b197
1.0.0b196
1.0.0b195
1.0.0b194
tb workspace members set-role.1.0.0b193
tb fmt, now Python code is better formatted1.0.0b192
--hide-tokens flag.1.0.0b191
tb datasource rm, also allowing Data Source forced deletion if it is the target of a materialized view.1.0.0b190
1.0.0b189
1.0.0b188
tb push pipe_file and there's a timeout1.0.0b187
tb fmt1.0.0b186
tb workspace create without additional arguments.--starter-kit to the tb workspace create command to allow applying an starter kit during workspace creation.1.0.0b185
tb fmt to better report usage1.0.0b184
tb fmt datafile_path to format a local datafile1.0.0b183
tb pipe data to actually respect the query pass as parameter1.0.0b182
regression-test1.0.0b181
tb truncate --cascade DS_name1.0.0b180
tb push or tb regression-test the validation of response time not increasing > 25% as the response time can variate according the the status of the cluster. Instead we have added a validation of the bytes read as it remains constant1.0.0b179
1.0.0b178
1.0.0b177
1.0.0b176
--override-datasource to tb push to override an existing Data Source by a new one with different settings when creating a Materialized View1.0.0b175
used_by field when doing calls to /v0/datasources to avoid unncessary work1.0.0b174
--ignore-empty to tb datasource replace to not throw error if the data is empty1.0.0b173
tb push --force and the push fails because there's an error in any Node. If the Pipe can't be overridden, the current Pipe remains untouched.tb push --force. The Materialized View gets unlinked, but the Data Source won't be removed.1.0.0b172
1.0.0b171
tb push or tb regression-test, the pipe checker will verify if new versions of the endpoint does not have a degradation of respose time.1.0.0b170
1.0.0b169
api column to tb auth ls output.1.0.0b168
1.0.0b167
1.0.0b166
tb datasource append command by making URL not mandatory.1.0.0b165
tb datasource X commands.1.0.0b164
tb workspace delete should ask for a user token if not provided.1.0.0b163
--token as a valid flag for tb auth.1.0.0b162
1.0.0b161
1.0.0b160
arr Array(String) DEFAULT ['-']1.0.0b159
tb datasource share to be able to share a datasource with another workspace--fork option to tb workspace create to share all the datasources when the workspace gets created1.0.0b158
tb workspace clear to skip Shared Data Sources correctly.1.0.0b157
--populate-sql-condition alias since it was misleading, it's enough with `tb push pipe --populate --sql-condition "the_condition"``1.0.0b156
tb auth. Now it automatically selects the proper region based on the provided token.1.0.0b155
1.0.0b154
--token. Now the update version warning is never displayed with this command.1.0.0b153
tb pipe populate command1.0.0b152
1.0.0b151
tb workspace clear. Now deletes all files in the workspace, not only the ones you have in your local folder.1.0.0b150
--sample-by-params when running tb push -f or tb pipe regression-test to specify the number of sample calls to validate against. For each combination of query parameters, we will sample the data and validate the results.1.0.0b149
1.0.0b148
tb pipe publish and tb pipe unpublish commands1.0.0b147
--recursive flag to tb dependencies to get recursive dependencies--populate-sql-condition as an alias for tb push pipe --populate --sql-condition1.0.0b146
tb test commandstb testtb test run return non-zero exit code on failure--fixtures option NDJSON fixtures (only CSV was supported before)1.0.0b145
--sql-condition to send an arbitrary SQL condition together with the --populate flag when pushing a materialized pipe. See tb push --help for usage information.1.0.0b144
1.0.0b143
1.0.0b142
1.0.0b141
1.0.0b140
1.0.0b139
1.0.0b138
1.0.0b137
--skip-table-checks1.0.0b136
--skip-table-checks1.0.0b135
1.0.0b134
1.0.0b133
tb check verifies also query syntax1.0.0b132
1.0.0b131
1.0.0b130
1.0.0b129
1.0.0b128
1.0.0b127
pipe command regression-test1.0.0b126
1.0.0b125
1.0.0b124
tb materializetb materialize properly supports --prefix and datafiles with VERSIONtb materialize documentation1.0.0b123
1.0.0b122
1.0.0b121
1.0.0b120
--failfast/-ff and --ignore-order to tb pipe regression-test and tb push1.0.0b119
1.0.0b118
1.0.0b117
tb push1.0.0b116
1.0.0b115
tb materialize command now is interactive1.0.0b114
1.0.0b113
1.0.0b112
1.0.0b111
1.0.0b110
1.0.0b109
1.0.0b108
--populate --sample by --populate --subset, since sample was misleading.1.0.0b107
tb datasource replace <name> --skip-incompatible-partition-key1.0.0b106
1.0.0b105
tb pipe ls, now it returns when a pipe was modified and not just when it was created1.0.0b104
1.0.0b103
tb push path/ allowing to push the content of a directory.1.0.0b102
tb workspace clear1.0.0b101
1.0.0b100
tb materialize path/to/pipe.pipe node_name. It analyzes the node_name SQL query to generate the .datasource and .pipe files needed to push a new materialize view.1.0.0b99
1.0.0b98
tb auth --interactive now supports custom regions1.0.0b97
--sample option for --populate1.0.0b96
1.0.0b95
1.0.0b94
1.0.0b93
1.0.0b92
tb pipe regression-test --help for more information about the new command.1.0.0b91
1.0.0b90
1.0.0b89
1.0.0b88
tb dependencies for situations where a Data Source contains a large number of dependent Data Sources.1.0.0b87
tb dependencies --datasource my_datasource --check-for-partial-replace1.0.0b86
1.0.0b85
1.0.0b84
--skip-table-checkspush errors1.0.0b83
TOKEN command1.0.0b82
1.0.0b81
1.0.0b80
1.0.0b78
1.0.0b77
1.0.0b76
1.0.0b75
delete subcommand to datasource to delete rows matching a SQL condition1.0.0b74
1.0.0b73
-i to tb auth --interactive1.0.0b72
1.0.0b71
1.0.0b70
1.0.0b69
--skip_update_validation in favor of --version_warning1.0.0b68
1.0.0b67
1.0.0b66
1.0.0b65
KAFKA_STORE_RAW_VALUE key.push --force a Kafka Data Source.,,)1.0.0b64
1.0.0b63
1.0.0b62
--timeout option when running tb push <PIPE>1.0.0b61
1.0.0b60
push, pull and append now work with NDJSON1.0.0b59
1.0.0b58
--skip-update-validation to skip the update validation that the CLI does to check for a new version1.0.0b57
--token and --host param for auth and workspace commands. This is useful when you want to automate commands via shell scripts or similar and you want to pass those parameters via environment variables without having to do tb auth with the token prompt. For instance tb --token <token> workspace ls will list the workspaces for the token passed as a parameter.1.0.0b56
1.0.0b55
1.0.0b54
1.0.0b53
tb datasource generate and tb datasource analyze to use the new v0/analyze API. It works with local and remote CSV and NDJSON files and Snowflake tables.1.0.0b52
INCLUDE "includes/${env}_secrests.incl"
and call tb like this
env=test tb push file.datasource
1.0.0b51
tb push --workspace option.1.0.0b50
Fixed Fixed duplicated rows in snowflake connector import1.0.0b49
tb auth --connector snowflake wizard1.0.0b48
1.0.0b47
1.0.0b46
1.0.0b45
shared from to the datasource ls command to show Data Source's original Workspace.1.0.0b44
ls command output--only-response-times flag when pushing a pipe. It'll just run regression tests related to check response times1.0.0b43
1.0.0b42
1.0.0b41
1.0.0b40
1.0.0b39
tb --host https://my-host/ auth1.0.0b38
tb datasource ls1.0.0b37
1.0.0b36
--ignore-sql-errors in tb push is no longer needed as we have fixed one of the underlying issues that was forcing its use on certain occasions.1.0.0b35
tb connection' commands. Supported connectors: Kafkatb datasource connect <id> command. Supported connectors: Kafka1.0.0b34
1.0.0b33
1.0.0b32
drop-prefix command, now it drops first pipes and its dependencies and then source data sources1.0.0b31
--token => TB_TOKEN envvar => .tinyb file.1.0.0b30
1.0.0b29
1.0.0b28
--skip-table-check error message to indicate how to use the flag1.0.0b27
--skip-table-check to skip materialized view and table checks1.0.0b26
1.0.0b25
tb job cancel <job_id>1.0.0b24
ingesting data from Snowflake <https://docs.tinybird.co/cli/snowflake.html>_1.0.0b23
tb datasource truncate <datasource_name>tb datasource replace <datasource_name> <URL or file>tb datasource replace <datasource_name> <URL or file> --sql-condition="country='ES'"ingesting data from BigQuery <https://docs.tinybird.co/cli/bigquery.html>_1.0.0b22
ENGINE_SETTINGS and ENGINE_TTL1.0.0b21
1.0.0b20
1.0.0b19
1.0.0b18
1.0.0b17
1.0.0b16
1.0.0b15
datasource rm command not working when there is a MV pointing to the datasource being removed1.0.0b14
1.0.0b13
1.0.0b12
ENGINE options to match the API parameters <https://docs.tinybird.co/api-reference/datasource-api.html#engines-parameters-and-options>_1.0.0b11
1.0.0b10
1.0.0b9
1.0.0b8
2020-08-28 1.0.0b7
2020-08-26: 1.0.0b6
2020-08-24: 1.0.0b5
2020-08-10: 1.0.0b4
2020-08-10: 1.0.0b3
tb sql to 100. Added --row-limit.datasources_ops_logINSERT sql statement is used.FAQs
Tinybird Command Line Tool
We found that tinybird-cli demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 3 open source maintainers collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Research
Security News
Malicious Go packages are impersonating popular libraries to install hidden loader malware on Linux and macOS, targeting developers with obfuscated payloads.
Security News
Bybit's $1.46B hack by North Korea's Lazarus Group pushes 2025 crypto losses to $1.6B in just two months, already surpassing all of 2024's $1.49B total.
Security News
OpenSSF has published OSPS Baseline, an initiative designed to establish a minimum set of security-related best practices for open source software projects.