@cumulus/pdr-status-check

@cumulus/pdr-status-check

Lambda function handler for checking the status of a workflow (step function) execution. Expects a payload object which includes the name of a PDR. The concurrency of SFN API calls is set to 10 by default, and it's configurable by setting the Lambda environment variable CONCURRENCY.

About Cumulus

Cumulus is a cloud-based data ingest, archive, distribution and management prototype for NASA's future Earth science data streams.

Cumulus Documentation

Contributing

To make a contribution, please see our contributing guidelines.

Changelog

[v20.1.2] 2025-04-22

Added

• CUMULUS-3868
  • added listGranulesConcurrency parameter to control the size of requests made to the listGranules api endpoint. this should be lowered from default if granuleIds are larger than 300 characters.
• CUMULUS-4004
  • Add documentation explaining use and configuration of changegranuleCollections workflow
• CUMULUS-3992
  • Update MoveCollectionsWorkflow references to ChangeGranuleCollectionsWorkflow
  • Update @cumulus/api-client to add bulkChangeCollection endpoint
  • Update @cumulus/api to add api endpoint to allow trigger of ChangeGranuleCollectionsWorkflow
  • Update ChangeGranuleCollections integration test to use endpoint to trigger test instead of direct step function invocation
• CUMULUS-3751
  • Added change-granule-collection-s3 to move granules to a different collection.
    • expects a list of granuleIds along with a new (target) collection
    • moves those granule files in S3 according to pathing of target collection
    • update CMR metadata file according to new collection information
  • Added CopyObject function in @cumulus/aws-client/S3 to facilitate multi-part s3 object copying
  • Added functions to allow manipulation in memory of cmr metadata objects in @cumulus/cmrjs/cmr-utils
    • updateUMMGMetadataObject updates file links for ummg metadata structure object
    • updateEcho10XMLMetadataObject updates file links for echo10 metadata structure object
    • setUMMGCollection sets collection name and version in ummg metadata structure object
    • setEcho10Collection sets collection name and version in echo10 metadata structure object
    • getCMRCollectionId gets collectionId from cmr metadata object using its filename to determine how to correctly parse the object (echo10 vs ummg)
  • Added MoveGranuleCollections workflow to cumulus core deployable according to terraform variables
  • Added ingest module terraform variable "deploy_cumulus_workflows": a map of workflows that should be deployed
    • as of merging only controls change_granule_collections_workflow
    • defaults to true (deploy the workflow)

Fixed

• CUMULUS-4090
  • add limit = number of granules to get return out as requested from listGranules
• CUMULUS-3868
  • exclude package cloudflare:sockets" in webpack.config throughout to prevent packaging bug
• CUMULUS-3752
  • Fixed api return codes expected in api-client for bulkPatch and bulkPatchGranuleCollections
• CUMULUS-3394
  • Updated DLA table column tables to lowercase to avoid recurring terraform update
• CUMULUS-4052
  • Removed outdated elasticsearch reference from 'bulk delete executions by collection' endpoint

Changed

• CUMULUS-3868

  • Use listGranules endpoint to gather granules from granuleIds
  • Bound cmr metadata download in post-to-cmr task to s3Concurrency limit

• CUMULUS-3788

  • Updated @cumulus/launchpad-auth/getLaunchpadToken to check if the token in s3 has been updated before updating it with a new token

• CUMULUS-3980

  • Updated bulkPatchGranuleCollection to error when the collection it is getting updated to doesn't exist

• CUMULUS-4077

  • Update list/search endpoints and corresponding BaseSearch @cumulus/db logic to allow countOnly as a configuration-modifying query parameter that only returns a useful value for meta.count to allow users to get a count without returning results/incurring pagination/translation costs

• CUMULUS-4057

  • Updated psql installation instruction for Amazon Linux 2023