Update Comunica monorepo packages to v5 (major)

[renovate]

ℹ️ Note

This PR body was truncated due to platform limits.

This PR contains the following updates:

Package	Change	Age	Confidence
@comunica/actor-init-query (source)	^2.2.0 → ^5.0.0
@comunica/config-query-sparql (source)	^2.0.1 → ^5.0.0
@comunica/config-query-sparql-solid (source)	^2.0.1 → ^5.0.0
@comunica/query-sparql (source)	^2.2.1 → ^5.0.0
@comunica/runner-cli (source)	^2.2.0 → ^5.0.0

---

Release Notes

comunica/comunica (@​comunica/actor-init-query)

v5.1.3

Compare Source

Fixed

• Update to Traqula 1.0.1, Closes #​1655
• Fix missing autoStart: false in QuerySourceHypermedia, #​1655

v5.1.0

Compare Source

Added

• Allow prefixes to passed to N3 serializer with rdfSerializationPrefixes

v5.0.3

Compare Source

Fixed

• Fix ActionContext#ensureActionContext failing in obfuscated environments

v5.0.2

Compare Source

Fixed

• Fix ActionContext#ensureActionContext failing on dual packages

Changed

• Bump shaclc dependencies to reduce bundle size

v5.0.1

Compare Source

Fixed

• Bump max bundle size

v5.0.0

Compare Source

BREAKING CHANGES

The following breaking changes will only impact users of Node.js < 20,
users that issue RDF/SPARQL-star queries (now interpreted as RDF/SPARQL 1.2),
and users that develop custom components or engines with Comunica.

• Drop Node 18 support and set TS target to es2023
• Remove link traversal logic from hypermedia actor
• Move query source identification to optimize bus
• Rename hypermedia-resolve bus to dereference-link
• Make HashFunction accept Iterable of variables instead of array
• Rewrite SERVICE clauses as query operation with annotated source

Added

• Add RDF and SPARQL 1.2 support (replaces RDF/SPARQL-star support)
  • Replace sparqljs parser by traqula
  • Migrate to traqula's extensible algebra (#​1614)
  • Update to N3.js v2
  • Add new functions related to literals with base direction
  • Add foundation for base direction support in functions
  • Support base directions and triple terms in query result serializers
  • Update to rdf-data-factory@2 and @​rdfjs/types@2
  • Handle version announcement for parsing RDF
  • Also error on unsupported versions as media type parameters on SPARQL endpoints
  • Emit error on unsupported versions at SPARQL endpoints
• Make HTTP caching take into account caching headers
  • Make caches depend on HTTP cache semantics
  • Add in-memory HTTP caching
  • Cache JSON-LD context in HTTP-dependent cache
• Support HTTP abort signals via httpAbortSignal context entry
• Add missing IQueryContextCommon entries
• Fallback SPARQL endpoint requests to original URL if SD URL 404's
• Add explain mode that outputs a query after optimization
• Move query serialization to a new dedicated bus

Fixed

• Fix lte operator not correctly handling error propagation
• Fix outer GRAPH ?g being considered in MINUS variable disjointness
• Destroy non-smallest streams in bind join
• Fix sd:defaultGraph parsing with QPF endpoints
• Don't rate limit 404's

v4.5.0

Compare Source

Added

• Handle sd:propertyFeature in SPARQL endpoints

Fixed

• Fix FragmentSelectorShape not matching on top-level disjunctions
• Fix outer GRAPH ?g being considered in MINUS variable disjointness
• Fix LIMIT not terminating link traversal (#​1634)

v4.4.1

Compare Source

Fixed

• Fix unsupported extension functions always being pushed to endpoints
  • Add option to always push down extension functions
  • If extension functions are undefined, always push them down

v4.4.0

Compare Source

Added

• Accept RDF/JS datasets as sources
• Include VoID metadata in SPARQL endpoint, Closes #​1545
• Add automatic type casting for xs:untypedAtomic
• Vary requests to SPARQL endpoints using Accept-Post header
• Allow fileBaseIRI to be set, Closes #​1540
• Send extension functions to remote SPARQL endpoints if supported.
  • Only push down extension functions to sources if allowed
  • List and detect extension functions in service descriptions

Changed

• Make sources field type in context less strict, Closes #​1615
• Make partial cardinality emission optional (#​1618)
• Cache identified sources in service operation actor
• Send short SPARQL endpoint requests as GET
• Update to immutable v5
• Optimizations:
  • Optimize OPTIONALs with expressions applying to only left or right
  • Avoid cartesian products in actor-rdf-join-inner-multi-smallest

Fixed

• Fix wrong handling of FILTER in OPTIONAL
• Fix distinctConstruct not working when over a single SPARQL endpoint
• Skip ActorIteratorTransformRecordIntermediateResults if context entry is missing
• Fix incorrect context being used during empty source pruning
• Use ASK to verify cardinality estimate-based source assignments (#​1587)

v4.3.0

Compare Source

Added

• Add identity based distinct actor, Closes #​52

Changed

• Optimize property path iterators with sync mappings
• Revert Webpack config files to JavaScript
• Move primary Webpack config back to actor-init-query

Fixed

• Fix property paths without variables over empty dataset not terminating
• Fix property paths with one variable over empty dataset not terminating
• Fix zero-or-more property paths over empty dataset not terminating
• Fix property paths not selecting all list elements, Closes #​1562
• Fix unionDefaultGraph not working on RDFJS sources, Closes #​1565
• Fix preflight metadata not getting propagated

v4.2.0

Compare Source

Added

• Add HTTP rate limit actor
• Add workaround for DBPedia SPARQL HTTP status 405 with Retry-After
• Add VoID metadata extract actor and cardinality estimation for SPARQL sources
• Allow SPARQL source actor to skip COUNTs for large queries
• Allow sending COUNT queries to be disabled for SPARQL endpoints
• Allow forcing SPARQL source type from config
• Add join sorter based on join selectivities
• Report the url when a fetch fails
• Add distinctConstruct key to IQueryContextCommon

Changed

• Detect SPARQL endpoints with trailing slashes, Closes #​1529
• Skip COUNT queries to singular SPARQL source
• Skip unnecessary SPARQL SD requests for a single source
• Update to rdf-streaming-store v2
• Try action.mediaType before doing heuristics for media type
• Avoid unnecessary parse attempts after dereferencing fails
• Avoid printing all metadata in join logging (#​1509)
• Avoid creation of intermediary triple objects for in-memory stores

Fixed

• Fix variable names in ActorOptimizeQueryOperationPruneEmptySourceOperations
• Fix incorrect id of actor-query-source-hypermedia-identify-sparql
• Fix GraphQL queries being sent to SPARQL endpoints, Closes #​1525
• Fix HTTP request count tracking, Closes #​1526
• Fix bad plans sometimes being chosen due to requestTime in files
• Fix regressions of initialBindings with BIND clauses
• Fix queries with complex property paths not terminating
• Avoid flattening joins with input-specific metadata (#​1522)
• Fix broken Dockerfile for query-sparql

v4.1.0

Compare Source

v4.1.0 - 2025-02-11

v4.0.2

Compare Source

Changed

• Document that algebra inputs should not contain blank nodes, Closes #​1234

Fixed

• Fix some zero-or-more path queries producing empty results, Closes #​1449

v4.0.1

Compare Source

BREAKING CHANGES

The following breaking changes will only impact users of Node.js < 18
and users that develop custom components or engines with Comunica.

• Remove backwards-compat for Node.js < 18
  • Remove cross-fetch and abort-controller polyfill as unnecessary
  • Update fetch-sparql-endpoint to version 5
  • Remove Node 14 backwards-compat in stats writer
• API changes
  • Refactor Actor.test to not rely on Promise rejections
    • All Actor.test methods must be changed to use passTest or failTest instead of promise rejections, for better performance.
  • Use variable.canBeUndef in metadata instead of canContainUndefs
  • Remove Actor.initialize and .deinitalize
  • Rename noCache CLI argument to invalidateCache
  • Remove hash collisions flag from hash buses
  • Return 32-bit numbers in hash bus based on specific variables
  • Allow inserts and deletes to execute in a single request
• Renamed or changed actors
  • Split expression functions into separate actors on dedicated bus
  • Split aggregators into separate actors on dedicated bus
  • Refactor HTTP fetch and retry logic
    • Retries of failed requests has been improved
    • The User-Agent header has been improved
    • A better approach to detect if Comunica is in a browser environment, compatible with Node.js, Deno, and Bun.
  • Remove SHA1 hash quads actor in favor of Murmur3
  • Remove SHA1 hash actor in favor of Murmur3
  • Abstract actor-rdf-join-minus-hash-undef into actor-rdf-join-minus-hash
• Move utilities
  • Add utils-query-operation and utils-iterator
    • These new packages contain helper functions that previously existed in bus-query-operation and bus-rdf-join.
  • Rename util packages to 'util-' scope
    • data-factory -> utils-data-factory
    • bindings-factory -> utils-bindings-factory
    • jest -> utils-jest
    • metadata -> utils-metadata
  • Move ActorRdfJoin.hashNonClashing to bindingsToCompactString
  • Delegate all join hashing to hash bus
  • Move bindings index from optional join to utils package

Added

• Add default Accept-Encoding header with Brotli
• Add undef support to inner hash join actor
• Forward side data from test to run in actors
• Allow plugging in custom DataFactory through context, Closes #​358

Changed

• Remove unneeded false default values on CLI boolean args
• Improve fragment selector shape handling
  • Make doesShapeAcceptOperation recurse into operations
  • Add dedicated wildcard operation type to FragmentSelectorShape
• Improve performance
  • Bump asyncjoin with hash join performance improvement
  • Only consider overlapping vars when testing undef in join actors
• Improve type inference in IActionContext, Closes #​933
• Emit planning time from stats writer
• Make stats writer measure time from actual query start
• Improve error reporting when mediators fail

Fixed

• Fix union not setting canContainUndefs to true if child vars differ

v3.3.0

Compare Source

Added

• Add statistics tracking

Changed

• Optimize Bindings merge logic

Fixed

• Fix source attribution for QPF and SPARQL endpoints (#​1420)
• Fix internal cardinalities being wrong for SPARQL endpoints with VoID
• Define inner join actor orders for NaN cardinalities

v3.2.1

Compare Source

Added

• Add support for deduplication of results in construct queries

Changed

• Remove projection variables missing warning
• Migrate parse-link-header to http-link-header
• Migrate stream-to-string and streamify-string
• Performance improvements:
  • Tweak default BindJoin.minMaxCardinalityRatio value for WatDiv-C1
  • Use Bind Join only if smallest much smaller than largest
  • Assign smallest stream as build side in Hash Join, #​884
  • Force NLJ when join entries have no overlapping variables

Fixed

• Fix optimizer incorrectly considering some optionals empty
• Fix SLICE actor not working with ASK queries, Closes #​1374
• Make projection variables missing error a warning instead
• Fix some unions in federated queries being pruned incorrectly, Closes #​1397
• Avoid single-entry joins in join-connected optimizer, #​1397
• Consider unions when determining if operation can produce undefs, #​1406
• Fix undefined values from SPARQL endpoints being produced
• Fix unnecessary join being created when binding over filter
• Fix initialBindings failing when done over projected variables

v3.2.0

Compare Source

Added

• Performance improvements:
  • Add optional hash join actor
• Add actors for bindings source attribution
• Add OPT+ operator

Changed

• Performance improvements:
  • Lower default ioWeight to tweak overall performance
  • Make optional hash and bind join only work with common variables
• Debugging and performance tracking:
  • Omit undefined join coefficients in debug logger
  • Emit timings and actual cardinalities in physical explain output
  • Make physical query plan explain output compact and human-readable
  • Compact Bind-Join operations in physical query explain output
  • Add BJ bindOperation to physical query explain output
  • Emit pattern source in physical query explain output

Fixed

• Fix undef sanity check for SPARQL endpoints sometimes going rogue
• Fix CONSTRUCT FROM not being sent to endpoints, Closes #​1389
• Fix empty media type not falling back to extension handling
• Fixed the order of count operations influencing the result
• Fix minus-hash using incorrect hash function

v3.1.0

Compare Source

Added

• Add @​comunica/query-sparql-rdfjs-lite that is optimized for bundle size

Changed

• Migrate from readable-web-to-node-stream to readable-from-web
• Move validateHttpResponse helper to avoid interdependencies

Fixed

• Avoid race conditions during DELETE/INSERT operations
• Catch 404 of non-existing resource when fetching the selector shape (#​1324)
• Always add preprocessed context to unidentified query sources (#​1337)

v3.0.3

Compare Source

Changed

• Add generic type to LinkQueueWrapper (#​1322)

Fixed

• Fix broken LIMITs on CONSTRUCT queries on SPARQL endpoints, Closes #​1319

v3.0.1

Compare Source

BREAKING CHANGES

• Rename sparqlee-specific package names
  • @comunica/actor-query-operation-filter-sparqlee -> @comunica/actor-query-operation-filter
  • @comunica/actor-query-operation-orderby-sparqlee -> @comunica/actor-query-operation-orderby
• Generalize sources to accept all query operations
  • The rdf-resolve-quad-pattern bus has been removed in favor of the new query-source-identify bus. This bus enables identification of IQuerySource's which can accept any kind of query operation, not just quad patterns like before.
  • brTPF support is added.
  • Bound joins are supported: pushing bindings into sources (FedX)
  • Several context-preprocess actors are added due to this, which offer:
    • Grouping operations into sources during federated querying (FedX)
    • Pushing down filters into sources
    • Skolemization of blank nodes
• Move sequential query process steps to separate bus and actor
• Move context shortcut handling to preprocess actor

Added

• Allow Bindings to have contexts
• Add timeout for sparql endpoint count queries
• Process source contexts to support shortcuts
• Add option to disable caching (#​1297)
• Allow sources to be annotated with traverse flag

Fixed

• Fix GROUP_CONCAT losing languages if equal

Changed

• Update to asynciterator 3.9.0 to make results async iterable
• Ensure QueryEngine instances are fully independent
• Update to Components.js v6

v2.10.2

Compare Source

Fixed

• Migrate to @​smessie/readable-web-to-node-stream

v2.10.1

Compare Source

Fixed

• Fix updates with body streams failing in Node >= 18
• Generalize fromBindings in BindingsFactory

v2.10.0

Compare Source

Added

• Convert raw source contexts to ActionContexts
• Support relative and absolute paths for COMUNICA_CONFIG

Changed

• Log expression error messages
• Print log levels in different colors
• Update readable-stream, yargs, lerna, typescript and eslint (#​1271)

Fixed

• Fix wrong cardinality for zero-or-one paths with one variable
• Support building with esModuleInterop TS flag
• Skip calling endsWith on mediaType when mediaType is undefined

v2.9.0

Compare Source

Changed

• Early close/destroy in hypermedia iterator when aggregatedStore is unused
• Update dependency uuid to v9 (#​1247)
• Migrate sparqlee into Comunica

Fixed

• Enable SPARQL-star for update queries to endpoints

v2.8.2

Compare Source

Fixed

• Fix aggregated store not containing first source after query re-exec

v2.8.1

Compare Source

Fixed

• Allow multi join actors to handle undefs, Closes #​1231
• Fix process halting on many TPF sources

v2.8.0

Compare Source

Added

• Add support for RDF-star and SPARQL-star
  • Support quoted triples in result serializers
  • Add support for processing quoted triples

Changed

• Update to rdf-store-stream v2
• Update dependency lru-cache to v10
• Update to TypeScript 5.x

v2.7.1

Compare Source

Changed

• Update dependency htmlparser2 to v9 (#​1211)
• Simplify stringSource actor implementation

Fixed

• Fix existence hook not provided error with OPTIONAL, Closes #​1029
• Fix stringSource syntax errors not being caught, Closes #​1192
• Fix bind join illegally being used over FILTERs
• Fix NaN selectivity for non-pattern operations

v2.7.0

Compare Source

Added

• Support durations, dates, and times in filters
• Add support for ZeroOrOne path expressions with 2 variables

Changed

• Improving Web support
  • Use process shim (#​1186)
• Improve performance with SPARQL endpoints
  • Improve metadata and lazyness in SPARQL hypermedia actor
  • Fix SPARQL endpoint operator always having canContainUndefs: true
  • Fix keepalive not being true in fetch-only environments
  • Cache count queries over SPARQL endpoints
• Enable incremental metadata updates
• Update dependency canonicalize to v2
• Make Bindings#merge and mergeWith accept more generic RDF.Bindings

Fixed

• Fix blank node scoping in CONSTRUCT queries, Closes #​1190
• Add missing baseIRI for shaclc
• Destroy unused iterators

v2.6.9

Compare Source

Changed

• Update to Node.js typings v18

Fixed

• Bump rdf-streaming-store with another fix for stream.push() after EOF
• Use globalThis instead of global
• Fix OPTIONAL failing to emit FILTERed results

v2.6.8

Compare Source

Changed

• Remove deprecated calls to lru-cache

Fixed

• Bump rdf-streaming-store with fix for stream.push() after EOF
• Fix aggregated store not ending when linked iterator is destroyed
• Scope aggregated stores in the query context

v2.6.7

Compare Source

Added

• Allow minimum sources check on CLI to be disabled
• Allow generic context type in QueryEngine to omit fields

v2.6.0

Compare Source

Added

• Add SHACLC parser and serializer
• Allow hypermedia actor to aggregate link queue in an index

Changed

• Use sparqlee's new type system

Fixed

• Fix invalid baseIRI when querying local files
• Fix errors in Node 19

v2.5.1

Compare Source

Fixed

• Add missing dependencies in file and rdfjs engines
• Rename wayback actor in config, Closes #​1086
• Add localizeBlankNodes to IQueryContextCommon
• Fix incorrect files entry in data-factory
• Add recoverBrokenLinks to IQueryContextCommon

v2.5.0

Compare Source

Added

• Enable engines to override context shortcuts and typings
• Support string-based data sources, Closes #​639
• Add support for HTTP retries
• Add wayback HTTP actor

Changed

• Add USER to Dockerfile
• Make QueryOperationAsk close the BindingsStream earlier
• Expose localizeBlankNodes on the CLI

Fixed

• Bump to asynciterator 3.8 with ESM packaging fix, Closes #​1097
• Include source map files in packed files
• Fix invalid blank node skolemization in DESCRIBE queries

v2.4.3

Compare Source

Fixed

• Add workaround for INSERT queries on Solid pods
• Add polyfill for Buffer in webpack

v2.4.1

Compare Source

Fixed

• Make global process override conditional

v2.4.0

Compare Source

Added

• Add logging on timeout handlers in HTTP service
• Emit metadata in SPARQL/JSON serializer
• Enable context overriding when running SPARQL endpoint

Changed

• Move away from Node.js built-ins to avoid polyfilling in tools such as Webpack
  • Replace setImmediate by setTimeout
  • Use performance.now instead of process.hrtime
  • Avoid using htmlparser2 stream feature
  • Remove xml dependencies
  • Remove dependency on web-streams-node
• Performance improvements:
  • Update to AsyncIterator 3.7.0
  • Rewrite */+ property paths with proper backpressure handling

Fixed

• Fix propagation of iterator destroying in various places
• Fix blocking operators delaying timeout start in HTTP service
• Fix halting when error occurs in extend operation
• Avoid applying @​babel/polyfill on the output code
• [Close connections on uncaught exceptions in HTTP service worke

---

Configuration

📅 Schedule: Branch creation - "before 7am every weekday" in timezone Europe/Brussels, Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.

---

• If you want to rebase/retry this PR, check this box

---

This PR was generated by Mend Renovate. View the repository job log.