@cumulus/cmrjs - npm Package Versions

[v18.5.5] 2025-03-04

Please note changes in v18.5.5 may not yet be released in future versions, as this is a backport/patch release on the v18.5.x series of releases. Updates that are included in the future will have a corresponding CHANGELOG entry in future releases.

Added

• CUMULUS-3993
  • Added long PAN functionality and panType configuration option to SendPan task
  • Updated example workflow configuration to better handle error exceptions, see Workflow Configuration
  • Updated PdrStatusCheck task to properly propagate workflow execution error.

[v20.0.0] 2025-02-04

[v18.5.3] 2025-01-21

Please note changes in v18.5.3 may not yet be released in future versions, as this is a backport/patch release on the v18.5.x series of releases. Updates that are included in the future will have a corresponding CHANGELOG entry in future releases.

Added

• CUMULUS-3757
  • Added a /granules endpoint PATCH/bulkPatchGranuleCollection which updates a batch of granule records collectionId to a new collectionId. This endpoint takes a list of granules, a collectionId, and an esConcurrency variable, updating the granules' to the collectionId passed with the payload in both postgres and elasticsearch, while providing concurrency for updating elasticsearch to tailor for performance and database needs.
  • Added a /granules endpoint PATCH/bulkPatch which applies PATCH to a list of granules. For its payload, this endpoint takes a list of granules (the updates to be made to the granule, similar to the pre-existing PATCH), a dbConcurrency and dbMaxPool variables for configuring concurrency and database thoroughput for postgres to tailor to performance and database needs.
• CUMULUS-3978
  • Added iops and throughput options to elasticsearch_config variable in tf-modules/data-persistence; These two options are necessary for gp3 EBS volume type.

Changed

• CUMULUS-3967

  • Pinned @aws-sdk/client-s3 in @cumulus/aws-client to 3.726.0 to address breaking changes/incompatibility in releases > 3.726.0
  • Pinned @aws-sdk/client-s3 in @cumulus/lib-storage to 3.726.0 to address breaking changes/incompatibility in releases > 3.726.0

• CUMULUS-3940

  • Added 'dead_letter_recovery_cpu' and 'dead_letter_recovery_memory' to cumulus and archive module configuration to allow configuration of the dead_letter_recovery_operation task definition to better allow configuration of the tool's operating environment.
  • Updated the dead letter recovery tool to utilize it's own log group "${var.prefix}-DeadLetterRecoveryEcsLogs"
  • Added batchSize, concurrency and dbMaxPool options to /endpoints/recoverCumulusMessage (note these values are correct at time of this release only):
    • batchSize - specifies how many DLA objects to read from S3 and hold in memory. Defaults to 1000.
    • concurrency - specifies how many messages to process at the same time. Defaults to 30.
    • dbMaxPool - specifies how many database connections to allow the process to utilize. Defaults to 30. Process should at minimum the value set for concurrency.
  • Add API memory-constrained performance test to test minimum functionality under default+ configuration
  • Updated @cumulus/async-operations.startAsyncOperation to take containerName` as a parameter name, allowing it to specify a container other than the default 'AsyncOperations' container

Fixed

• CUMULUS-3940
  • Updated process-s3-dead-letter-archive and downstream calls to pass in a esClient to writeRecordsFunction and update downstream calls to utilize the client.
• CUMULUS-3981
  • Added required $metadata field when creating new instance of ServiceException.

[v18.5.2] 2024-12-12

Breaking Changes

• CUMULUS-3934
  • Removed ecs_cluster_instance_allow_ssh resource.
  • The ecs_cluster_instance_allow_ssh was implemented before SSM hosts were deployed to NGAP accounts and allowed for SSHing into an instance from an SSH bastion, which no longer exists.
  • Tunneling into an EC2 via SSM is still supported. Users relying solely on SSH will need to transition to SSM.

Changed

• CUMULUS-3936,CUMULUS-3948
  • Updated tf-modules/cumulus/ecs_cluster_instance_autoscaling_cf_template.yml.tmpl user-data for compatibility with Amazon Linux 2023 AMI
  • Fixed tf-modules/cumulus scripts to use Instance Metadata Service V2
  • Updated fake-provider-cf.yml to work for Amazon Linux 2023 AMI
• CUMULUS-3941
  • Updated SendPan task to generate short pan with FAILED disposition.
• CUMULUS-3955
  • Removed VACUUM statements from db migrations. In cases where the PG database is very large, these queries can take a long time and exceed the Lambda timeout, causing failures on deployment.

Fixed

• Security Vulnerabilities
  • Updated @octokit/graphql from 2.1.1 to ^2.3.0 to address [CVE-2024-21538] (https://github.com/advisories/GHSA-3xgq-45jj-v275)

[v19.1.0] 2024-10-07

Migration Notes

This release contains changes listed here as well as changes listed in v19.0.0, despite v19.0.0 being deprecated. Please review Changelog entries and Migration Notes for each Cumulus version between your current version and v19.1.0 as normal.

Added

• CUMULUS-3020

  • Updated sfEventSqsToDbRecords to allow override of the default value (var.rds_connection_timing_configuration.acquireTimeoutMillis / 1000) + 60) via a key 'sfEventSqsToDbRecords' on var.lambda_timeouts on the main cumulus module/archive module

  Please note - updating this configuration is for adavanced users only. Value changes will modify the visibility timeout on sfEventSqsToDbRecordsDeadLetterQueue and sfEventSqsToDbRecordsInputQueue and may lead to system instability.

• CUMULUS-3756

  • Added excludeFileRegex configuration to UpdateGranulesCmrMetadataFileLinks
  • This is to allow files matching specified regex to be excluded when updating the Related URLs list
  • Defaults to the current behavior of excluding no files.

• CUMULUS-3773

  • Added sftpFastDownload configuration to SyncGranule task.
  • Updated @cumulus/sftp-client and @cumulus/ingest/SftpProviderClient to support both regular and fastDownload.
  • Added sftp support to FakeProvider
  • Added sftp integration test

Changed

• CUMULUS-3928
  • updated publish scripting to use cumulus.bot@gmail.com for user email
  • updated publish scripting to use esm over common import of latest-version
  • updated bigint testing to remove intermitted failure source.
  • updated postgres dependency version
• CUMULUS-3838
  • Updated python dependencies to latest:
    • cumulus-process-py 1.4.0
    • cumulus-message-adapter-python 2.3.0
• CUMULUS-3906
  • Bumps example ORCA deployment to version v10.0.1.

Fixed

• CUMULUS-3940
  • Updated process-s3-dead-letter-archive and downstream calls to pass in a esClient to writeRecordsFunction and update downstream calls to utilize the client.
• CUMULUS-3904
  • Passed sqs_message_consumer_watcher_message_limit and sqs_message_consumer_watcher_time_limit through the cumulus terraform module to the ingest terraform module.
• CUMULUS-3902
  • Update error handling to use AWS SDK V3 error classes instead of properties on js objects

[v18.5.1] 2024-10-25

Please note changes in v18.5.1 may not yet be released in future versions, as this is a backport/patch release on the v18.5.x series of releases. Updates that are included in the future will have a corresponding CHANGELOG entry in future releases.

Added

• CUMULUS-3773
  • Added sftpFastDownload configuration to SyncGranule task.
  • Updated @cumulus/sftp-client and @cumulus/ingest/SftpProviderClient to support both regular and fastDownload.
  • Added sftp support to FakeProvider
  • Added sftp integration test
• CUMULUS-3756
  • Added excludeFileRegex configuration to UpdateGranulesCmrMetadataFileLinks
  • This is to allow files matching specified regex to be excluded when updating the Related URLs list
  • Defaults to the current behavior of excluding no files.
• CUMULUS-3919
  • Added terraform variables disableSSL and rejectUnauthorized to tf-modules/cumulus-rds-tf module.

Changed

• CUMULUS-3928
  • updated publish scripting to use cumulus.bot@gmail.com for user email
  • updated publish scripting to use esm over common import of latest-version
  • updated bigint testing to remove intermitted failure source.
  • updated postgres dependency version
• CUMULUS-3838
  • Updated python dependencies to latest:
    • cumulus-process-py 1.4.0
    • cumulus-message-adapter-python 2.3.0

Fixed

• CUMULUS-3902
  • Update error handling to use AWS SDK V3 error classes instead of properties on js objects