Skip to content

Choose a tag to compare

@klockla klockla released this 23 Oct 12:16
· 2 commits to master since this release
902b55e

What's Changed

This release adds the following notables changes:

  • Implementation of setCrawlLimit
  • gRPC server reflection is now enabled
  • Addition of new method CountURLs to count the URLs for a given crawl.
  • Internal use a concurrent ordered map instead of a synchronized LinkedHashMap to allow for better concurrency
    (especially while using ListURLs and CountURLs which can be lengthy operations)

##Detailed list of changes

  • Implement setCrawlLimit inside the service by @zaibacu in #109
  • enable grpc server reflection by @jdpedrie in #112
  • Use replace instead of replaceall by @klockla in #113
  • Added CloseableIterator interface by @klockla in #115
  • Added method to count URLs in a frontier by @klockla in #114
  • Added ConcurrentOrdereredMap to avoid synchronization on GetQueues by @klockla in #117
  • Bump logback version to 1.5.17 by @klockla in #118
  • Updated versions of actions to v4 by @jnioche in #121
  • Fix iterators in case we have removed an entry by @klockla in #120
  • Fix deadlock between remove and pollFirstEntry by @klockla in #123
  • Optimize RocksDBURLItemIterator.next() by @klockla in #124
  • Added test for reschedule of Known URL by @klockla in #125
  • Bump org.apache.commons:commons-lang3 from 3.17.0 to 3.18.0 in /service in the maven group across 1 directory by @dependabot[bot] in #126
  • Make sure iterator will be closed in case of early exceptions by @klockla in #129
  • Adding missing synchronized on pollFirstEntry by @klockla in #130
  • Update protobuf to 3.25.8 and grpc to 1.75.0 by @klockla in #131
  • Bump grpc, rocksb, commons-lang & maven shade plugin dependencies by @klockla in #132
  • Use protobuf-maven-plugin to generate Protobuf and Grpc code by @klockla in #133
  • Update Protobuf documentation by @klockla in #135
  • Migrate publishing from OSSRH to Central Portal by @klockla in #134
  • Release 2.5 by @klockla in #136

New Contributors

Full Changelog: 2.4...2.5