@comunica/actor-http-wayback - npm Package Versions

v4.2.0 - 2025-04-29

Added

• Add HTTP rate limit actor
• Add workaround for DBPedia SPARQL HTTP status 405 with Retry-After
• Add VoID metadata extract actor and cardinality estimation for SPARQL sources
• Allow SPARQL source actor to skip COUNTs for large queries
• Allow sending COUNT queries to be disabled for SPARQL endpoints
• Allow forcing SPARQL source type from config
• Add join sorter based on join selectivities
• Report the url when a fetch fails
• Add distinctConstruct key to IQueryContextCommon

Changed

• Detect SPARQL endpoints with trailing slashes, Closes #1529
• Skip COUNT queries to singular SPARQL source
• Skip unnecessary SPARQL SD requests for a single source
• Update to rdf-streaming-store v2
• Try action.mediaType before doing heuristics for media type
• Avoid unnecessary parse attempts after dereferencing fails
• Avoid printing all metadata in join logging (#1509)
• Avoid creation of intermediary triple objects for in-memory stores

Fixed

• Fix variable names in ActorOptimizeQueryOperationPruneEmptySourceOperations
• Fix incorrect id of actor-query-source-hypermedia-identify-sparql
• Fix GraphQL queries being sent to SPARQL endpoints, Closes #1525
• Fix HTTP request count tracking, Closes #1526
• Fix bad plans sometimes being chosen due to requestTime in files
• Fix regressions of initialBindings with BIND clauses
• Fix queries with complex property paths not terminating
• Avoid flattening joins with input-specific metadata (#1522)
• Fix broken Dockerfile for query-sparql

<a name="v4.1.0"></a>

v4.1.0 - 2025-02-11

<a name="v4.1.0"></a>

v4.0.2 - 2024-10-16

Changed

• Document that algebra inputs should not contain blank nodes, Closes #1234

Fixed

• Fix some zero-or-more path queries producing empty results, Closes #1449

<a name="v4.0.1"></a>

v4.0.1 - 2024-10-15

BREAKING CHANGES

The following breaking changes will only impact users of Node.js < 18 and users that develop custom components or engines with Comunica.

• Remove backwards-compat for Node.js < 18
  • Remove cross-fetch and abort-controller polyfill as unnecessary
  • Update fetch-sparql-endpoint to version 5
  • Remove Node 14 backwards-compat in stats writer
• API changes
  • Refactor Actor.test to not rely on Promise rejections
    • All Actor.test methods must be changed to use passTest or failTest instead of promise rejections, for better performance.
  • Use variable.canBeUndef in metadata instead of canContainUndefs
  • Remove Actor.initialize and .deinitalize
  • Rename noCache CLI argument to invalidateCache
  • Remove hash collisions flag from hash buses
  • Return 32-bit numbers in hash bus based on specific variables
  • Allow inserts and deletes to execute in a single request
• Renamed or changed actors
  • Split expression functions into separate actors on dedicated bus
  • Split aggregators into separate actors on dedicated bus
  • Refactor HTTP fetch and retry logic
    • Retries of failed requests has been improved
    • The User-Agent header has been improved
    • A better approach to detect if Comunica is in a browser environment, compatible with Node.js, Deno, and Bun.
  • Remove SHA1 hash quads actor in favor of Murmur3
  • Remove SHA1 hash actor in favor of Murmur3
  • Abstract actor-rdf-join-minus-hash-undef into actor-rdf-join-minus-hash
• Move utilities
  • Add utils-query-operation and utils-iterator
    • These new packages contain helper functions that previously existed in bus-query-operation and bus-rdf-join.
  • Rename util packages to 'util-' scope
    • data-factory -> utils-data-factory
    • bindings-factory -> utils-bindings-factory
    • jest -> utils-jest
    • metadata -> utils-metadata
  • Move ActorRdfJoin.hashNonClashing to bindingsToCompactString
  • Delegate all join hashing to hash bus
  • Move bindings index from optional join to utils package

Added

• Add default Accept-Encoding header with Brotli
• Add undef support to inner hash join actor
• Forward side data from test to run in actors
• Allow plugging in custom DataFactory through context, Closes #358

Changed

• Remove unneeded false default values on CLI boolean args
• Improve fragment selector shape handling
  • Make doesShapeAcceptOperation recurse into operations
  • Add dedicated wildcard operation type to FragmentSelectorShape
• Improve performance
  • Bump asyncjoin with hash join performance improvement
  • Only consider overlapping vars when testing undef in join actors
• Improve type inference in IActionContext, Closes #933
• Emit planning time from stats writer
• Make stats writer measure time from actual query start
• Improve error reporting when mediators fail

Fixed

• Fix union not setting canContainUndefs to true if child vars differ

<a name="v3.3.0"></a>

v3.3.0 - 2024-10-08

Added

• Add statistics tracking

Changed

• Optimize Bindings merge logic

Fixed

• Fix source attribution for QPF and SPARQL endpoints (#1420)
• Fix internal cardinalities being wrong for SPARQL endpoints with VoID
• Define inner join actor orders for NaN cardinalities

<a name="v3.2.3"></a>

v3.2.1 - 2024-08-07

Added

• Add support for deduplication of results in construct queries

Changed

• Remove projection variables missing warning
• Migrate parse-link-header to http-link-header
• Migrate stream-to-string and streamify-string
• Performance improvements:
  • Tweak default BindJoin.minMaxCardinalityRatio value for WatDiv-C1
  • Use Bind Join only if smallest much smaller than largest
  • Assign smallest stream as build side in Hash Join, #884
  • Force NLJ when join entries have no overlapping variables

Fixed

• Fix optimizer incorrectly considering some optionals empty
• Fix SLICE actor not working with ASK queries, Closes #1374
• Make projection variables missing error a warning instead
• Fix some unions in federated queries being pruned incorrectly, Closes #1397
• Avoid single-entry joins in join-connected optimizer, #1397
• Consider unions when determining if operation can produce undefs, #1406
• Fix undefined values from SPARQL endpoints being produced
• Fix unnecessary join being created when binding over filter
• Fix initialBindings failing when done over projected variables

<a name="v3.2.0"></a>

v3.2.0 - 2024-07-05

Added

• Performance improvements:
  • Add optional hash join actor
• Add actors for bindings source attribution
• Add OPT+ operator

Changed

• Performance improvements:
  • Lower default ioWeight to tweak overall performance
  • Make optional hash and bind join only work with common variables
• Debugging and performance tracking:
  • Omit undefined join coefficients in debug logger
  • Emit timings and actual cardinalities in physical explain output
  • Make physical query plan explain output compact and human-readable
  • Compact Bind-Join operations in physical query explain output
  • Add BJ bindOperation to physical query explain output
  • Emit pattern source in physical query explain output

Fixed

• Fix undef sanity check for SPARQL endpoints sometimes going rogue
• Fix CONSTRUCT FROM not being sent to endpoints, Closes #1389
• Fix empty media type not falling back to extension handling
• Fixed the order of count operations influencing the result
• Fix minus-hash using incorrect hash function

<a name="v3.1.2"></a>

v3.1.2 - 2024-05-30

Fixed

• Fix next page requests not being logged anymore
• Fix performance regression of TPF queries

Changed

• Improve performance:
  • Use AsyncIterator.map and .filter instead of expensive .transform
  • Improve performance of hashing during hash joins
  • Optimize usage of bindingsStream transform in PathNps actor
• Use event-emitter-promisify package
• Cleanup stream operations (#1349)
• Maintain backpressure in result serializers
• Maintain backpressure on internal actors
• Don't log if no sources are pruned
• Use cancel in wayback actor when available, Closes #1351

<a name="v3.1.1"></a>