@cumulus/aws-client - npm Package Versions

[v10.1.2] 2022-03-11

Added

• CUMULUS-2859
  • Update postgres-db-migration lambda timeout to default 900 seconds
  • Add db_migration_lambda_timeout variable to data-persistence module to allow this timeout to be user configurable
• CUMULUS-2868
  • Added iam:PassRole permission to step_policy in tf-modules/ingest/iam.tf

[v10.1.1] 2022-03-04

Migration steps

• Due to a bug in the PUT /rules/<name> endpoint, the rule records in PostgreSQL may be out of sync with records in DynamoDB. In order to bring the records into sync, re-run the previously deployed data-migration1 Lambda with a payload of {"forceRulesMigration": true}:

aws lambda invoke --function-name $PREFIX-data-migration1 \
  --payload $(echo '{"forceRulesMigration": true}' | base64) $OUTFILE

Added

• CUMULUS-2841

  • Add integration test to validate PDR node provider that requires password credentials succeeds on ingest

• CUMULUS-2846

  • Added @cumulus/db/translate/rule.translateApiRuleToPostgresRuleRaw to translate API rule to PostgreSQL rules and keep undefined fields

Changed

• CUMULUS-NONE

  • Adds logging to ecs/async-operation Docker container that launches async tasks on ECS. Sets default async_operation_image_version to 39.

• CUMULUS-2845

  • Updated rules model to decouple createRuleTrigger from create.
  • Updated rules POST endpoint to call rulesModel.createRuleTrigger directly to create rule trigger.
  • Updated rules PUT endpoints to call rulesModel.createRuleTrigger if update fails and reversion needs to occur.

• CUMULUS-2846

  • Updated version of localstack/localstack used in local unit testing to 0.11.5

Fixed

• Upgraded lodash to version 4.17.21 to fix vulnerability
• CUMULUS-2845
  • Fixed bug in POST /rules endpoint causing rule records to be created inconsistently in DynamoDB and PostgreSQL
• CUMULUS-2846
  • Fixed logic for PUT /rules/<name> endpoint causing rules to be saved inconsistently between DynamoDB and PostgreSQL
• CUMULUS-2854
  • Fixed queue granules behavior where the task was not accounting for granules that already had createdAt set. Workflows downstream in this scenario should no longer fail to write their granules due to order-of-db-writes constraints in the database update logic.

[v10.1.0] 2022-02-23

Added

• CUMULUS-2775
  • Added a configurable parameter group for the RDS serverless database cluster deployed by tf-modules/rds-cluster-tf. The allowed parameters for the parameter group can be found in the AWS documentation of allowed parameters for an Aurora PostgreSQL cluster. By default, the following parameters are specified:
    • shared_preload_libraries: pg_stat_statements,auto_explain
    • log_min_duration_statement: 250
    • auto_explain.log_min_duration: 250
• CUMULUS-2781
  • Add api_config secret to hold API/Private API lambda configuration values
• CUMULUS-2840
  • Added an index on granule_cumulus_id to the RDS files table.

Changed

• CUMULUS-2492
  • Modify collectionId logic to accomodate trailing underscores in collection short names. e.g. shortName____
• CUMULUS-2847
  • Move DyanmoDb table name into API keystore and initialize only on lambda cold start
• CUMULUS-2833
  • Updates provider model schema titles to display on the dashboard.
• CUMULUS-2837
  • Update process-s3-dead-letter-archive to unpack SQS events in addition to Cumulus Messages
  • Update process-s3-dead-letter-archive to look up execution status using getCumulusMessageFromExecutionEvent (common method with sfEventSqsToDbRecords)
  • Move methods in api/lib/cwSfExecutionEventUtils to @cumulus/message/StepFunctions
• CUMULUS-2775
  • Changed the timeout_action to ForceApplyCapacityChange by default for the RDS serverless database cluster tf-modules/rds-cluster-tf
• CUMULUS-2781
  • Update API lambda to utilize api_config secret for initial environment variables

Fixed

• CUMULUS-2853
  • Move OAUTH_PROVIDER to lambda env variables to address regression in CUMULUS-2781
  • Add logging output to api app router
• Added Cloudwatch permissions to <prefix>-steprole in tf-modules/ingest/iam.tf to address the Error: error creating Step Function State Machine (xxx): AccessDeniedException: 'arn:aws:iam::XXX:role/xxx-steprole' is not authorized to create managed-rule error in non-NGAP accounts:
  • events:PutTargets
  • events:PutRule
  • events:DescribeRule

[v9.9.3] 2021-02-17 [BACKPORT]

Please note changes in 9.9.3 may not yet be released in future versions, as this is a backport and patch release on the 9.9.x series of releases. Updates that are included in the future will have a corresponding CHANGELOG entry in future releases.

• CUMULUS-2853
  • Move OAUTH_PROVIDER to lambda env variables to address regression in 9.9.2/CUMULUS-2275
  • Add logging output to api app router

[v9.9.2] 2021-02-10 [BACKPORT]

Please note changes in 9.9.2 may not yet be released in future versions, as this is a backport and patch release on the 9.9.x series of releases. Updates that are included in the future will have a corresponding CHANGELOG entry in future releases.### Added

• CUMULUS-2775
  • Added a configurable parameter group for the RDS serverless database cluster deployed by tf-modules/rds-cluster-tf. The allowed parameters for the parameter group can be found in the AWS documentation of allowed parameters for an Aurora PostgreSQL cluster. By default, the following parameters are specified:
    • shared_preload_libraries: pg_stat_statements,auto_explain
    • log_min_duration_statement: 250
    • auto_explain.log_min_duration: 250
• CUMULUS-2840
  • Added an index on granule_cumulus_id to the RDS files table.

Changed

• CUMULUS-2847
  • Move DyanmoDb table name into API keystore and initialize only on lambda cold start
• CUMULUS-2781
  • Add api_config secret to hold API/Private API lambda configuration values
• CUMULUS-2775
  • Changed the timeout_action to ForceApplyCapacityChange by default for the RDS serverless database cluster tf-modules/rds-cluster-tf

[v9.4.1] 2022-02-14 [BACKPORT]

Please note changes in 9.4.1 may not yet be released in future versions, as this is a backport and patch release on the 9.4.x series of releases. Updates that are included in the future will have a corresponding CHANGELOG entry in future releases.

• CUMULUS-2847
  • Update dynamo configuration to read from S3 instead of System Manager Parameter Store
  • Move api configuration initialization outside the lambda handler to eliminate unneded S3 calls/require config on cold-start only
  • Moved ssh2 package from @cumulus/common to @cumulus/sftp-client and upgraded package from ^0.8.7 to ^1.0.0 to address security vulnerability issue in previous version.
  • Fixed hyrax task package.json dev dependency
  • Update CNM lambda dependencies for Core tasks
    • cumulus-cnm-response-task: 1.4.4
    • cumulus-cnm-to-granule: 1.5.4
  • Whitelist ssh2 re: https://github.com/advisories/GHSA-652h-xwhf-q4h6

[v9.9.1] 2021-02-10 [BACKPORT]

Please note changes in 9.9.1 may not yet be released in future versions, as this is a backport and patch release on the 9.9.x series of releases. Updates that are included in the future will have a corresponding CHANGELOG entry in future releases.

Fixed

• CUMULUS-2775
  • Updated @cumulus/api-client to not log an error for 201 response from updateGranule

Changed

• Updated version of @cumulus/cumulus-message-adapter-js from 2.0.3 to 2.0.4 for all Cumulus workflow tasks
• CUMULUS-2775
  • Changed @cumulus/api-client/invokeApi() to accept a single accepted status code or an array of accepted status codes via expectedStatusCodes
• CUMULUS-2837
  • Update process-s3-dead-letter-archive to unpack SQS events in addition to Cumulus Messages
  • Update process-s3-dead-letter-archive to look up execution status using getCumulusMessageFromExecutionEvent (common method with sfEventSqsToDbRecords)
  • Move methods in api/lib/cwSfExecutionEventUtils to @cumulus/message/StepFunctions

[v10.0.1] 2022-02-03

Fixed

• Fixed IAM permissions issue with <prefix>-postgres-migration-async-operation Lambda which prevented it from running a Fargate task for data migration.