Code

[improve][broker] Do-not-merge#251

Code

Closed

mukesh-ctds wants to merge 81 commits into3.1_dsdatastax/pulsar:3.1_dsfrom 3.1_ds_cherrypicks_from_3.0-fixdatastax/pulsar:3.1_ds_cherrypicks_from_3.0-fixCopy head branch name to clipboard

+6,157-1,833

Commits

Commits on Apr 12, 2024

• [improve][build] Upgrade dependency to fix CVE. (apache#20264)

  Show description for ab1dd7d
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  ab1dd7d

  Copy full SHA for ab1dd7d

• Revert "[fix][broker] Fix NPE when reset Replicator's cursor by position. (apache#20597)"

  Show description for 89367a3
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  89367a3

  Copy full SHA for 89367a3

• Revert Add listener interface for namespace service apache#20406

  Show description for c554f96
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  c554f96

  Copy full SHA for c554f96

• [fix][io][branch-3.0] Not restart instance when kafka source poll exception. (apache#20818)

  Show description for 9c35426
  

  shibd

  authored and

  mukesh-ctds

  committed
  9c35426

  Copy full SHA for 9c35426

• [fix] [ml] fix discontinuous ledger deletion (apache#20898)

  Show description for f2b97d7
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  f2b97d7

  Copy full SHA for f2b97d7

• [fix] [bk] Correctct the bookie info after ZK client is reconnected (apache#21035)

  Show description for b700488
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  b700488

  Copy full SHA for b700488

• Revert "[fix][broker] Fix get topic policies as null during clean cache (apache#20763)"

  Show description for 2a435c1
  

  coderzc

  authored and

  mukesh-ctds

  committed
  2a435c1

  Copy full SHA for 2a435c1

Commits on Apr 15, 2024

• [fix] [broker] Producer is blocked on creation because backlog exceeded on topic, when dedup is enabled and no producer is there (apache#20951)

  Show description for 385adae
  

  heesung-sn

  authored and

  mukesh-ctds

  committed
  385adae

  Copy full SHA for 385adae

• [improve] [broker] Improve cache handling for partitioned topic metadata when doing lookup (apache#21063)

  Show description for f6396d5
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  f6396d5

  Copy full SHA for f6396d5

• [fix][ci] Fix missing binary license (apache#21176)

  Show description for 53665ee
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  53665ee

  Copy full SHA for 53665ee

• Merge branch '3.1_ds' into 3.1_ds_cherrypicks_from_3.0

  mukesh-ctds

  authored
  8d1e249

  Copy full SHA for 8d1e249

• [improve] [broker] improve read entry error log for troubleshooting (apache#21169)

  Show description for 7fe00d4
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  7fe00d4

  Copy full SHA for 7fe00d4

• Revert "[fix][ci] Fix missing binary license (apache#21176)"

  Show description for bdd5e75
  mukesh-ctds

  committed
  bdd5e75

  Copy full SHA for bdd5e75

• [improve] [proxy] Not close the socket if lookup failed caused by too many requests (apache#21216)

  Show description for 3429c27
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  3429c27

  Copy full SHA for 3429c27

• [improve] [broker] Print warn log if ssl handshake error & print ledger id when switch ledger (apache#21201)

  Show description for b54ed95
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  b54ed95

  Copy full SHA for b54ed95

• [fix] [client] fix reader.hasMessageAvailable return false when incoming queue is not empty (apache#21259)

  Show description for 89dcb8c
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  89dcb8c

  Copy full SHA for 89dcb8c

• [fix] [ml] Reader can set read-pos to a deleted ledger (apache#21248)

  Show description for 7f25a18
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  7f25a18

  Copy full SHA for 7f25a18

• [fix] [ml] fix wrong msg backlog of non-durable cursor after trim ledgers (apache#21250)

  Show description for 981a82a
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  981a82a

  Copy full SHA for 981a82a

• [fix] [broker] Make the new exclusive consumer instead the inactive one faster (apache#21183)

  Show description for 82f77bc
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  82f77bc

  Copy full SHA for 82f77bc

• [fix] [build] Remove test testNoOrphanTopicIfInitFailed (apache#21569)

  Show description for 0799c8e
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  0799c8e

  Copy full SHA for 0799c8e

• [fix] [broker] [branch-3.0] Fast fix infinite HTTP call createSubscriptions caused by wrong topicName (apache#21997)

  Show description for 58a421a
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  58a421a

  Copy full SHA for 58a421a

• [fix][broker] Fix String wrong format (apache#21829)

  Show description for 3e3efe6
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  3e3efe6

  Copy full SHA for 3e3efe6

• [improve][admin][branch-3.0] Expose the offload threshold in seconds to the admin (apache#22169)

  Show description for 22fb6d6
  

  zymap

  authored and

  mukesh-ctds

  committed
  22fb6d6

  Copy full SHA for 22fb6d6

• [improve][fn][branch-3.0] Add missing "exception" argument to some log.error (apache#22140) (apache#22213)

  Show description for f005d6f
  

  jiangpengcheng

  authored and

  mukesh-ctds

  committed
  f005d6f

  Copy full SHA for f005d6f

• [improve][broker] Change log level to reduce duplicated logs (apache#22147)

  Show description for e350c0d
  

  mattisonchao

  authored and

  mukesh-ctds

  committed
  e350c0d

  Copy full SHA for e350c0d

• [fix][client] GenericProtobufNativeSchema not implement getNativeSchema method. (apache#22204)

  Show description for 166f986
  

  shibd

  authored and

  mukesh-ctds

  committed
  166f986

  Copy full SHA for 166f986

• Check the validity of config before start websocket service (apache#22231)

  Show description for 3718f35
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  3718f35

  Copy full SHA for 3718f35

• Fix the tests with same namespace name (apache#22240)

  Show description for d019f43
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  d019f43

  Copy full SHA for d019f43

• [improve][broker] Add missing configuration keys for caching catch-up reads (apache#22295)

  Show description for ebba0b5
  

  lhotari

  authored and

  mukesh-ctds

  committed
  ebba0b5

  Copy full SHA for ebba0b5

• [fix] [client] Unclear error message when creating a consumer with two same topics (apache#22255)

  Show description for 58e26ce
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  58e26ce

  Copy full SHA for 58e26ce

• [fix] [broker] Close dispatchers stuck due to mismatch between dispatcher.consumerList and dispatcher.consumerSet (apache#22270)

  Show description for d1b4de1
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  d1b4de1

  Copy full SHA for d1b4de1

• [fix] [broker] fix mismatch between dispatcher.consumerList and dispatcher.consumerSet (apache#22283)

  Show description for e6534f2
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  e6534f2

  Copy full SHA for e6534f2

• [fix][sec] Bump google.golang.org/grpc from 1.38.0 to 1.56.3 in /pulsar-function-go (apache#21444)

  Show description for 02ff191
  

  dependabot[bot]

  authored and

  mukesh-ctds

  committed
  02ff191

  Copy full SHA for 02ff191

• [fix][sec] Go Functions security updates (apache#21844)

  Show description for cd3046d
  

  merlimat

  authored and

  mukesh-ctds

  committed
  cd3046d

  Copy full SHA for cd3046d

• [improve][admin] Fix the createMissingPartitions doesn't response correctly (apache#22311)

  Show description for 63ccb5f
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  63ccb5f

  Copy full SHA for 63ccb5f

• [fix][client]Fixed getting an incorrect maxMessageSize value when accessing multiple clusters in the same process (apache#22306)

  Show description for 765d629
  

  chenhongSZ

  authored and

  mukesh-ctds

  committed
  765d629

  Copy full SHA for 765d629

• [fix][ml]Expose ledger timestamp (apache#22338)

  Show description for 26171ca
  

  dao-jun

  authored and

  mukesh-ctds

  committed
  26171ca

  Copy full SHA for 26171ca

• [fix] [test] Fix flaky test ManagedLedgerTest.testGetNumberOfEntriesInStorage (apache#22344)

  Show description for 05559fd
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  05559fd

  Copy full SHA for 05559fd

• [fix][test] Fix flaky ManagedLedgerErrorsTest.recoverAfterZnodeVersionError (apache#22368)

  Show description for 4d634a5
  

  lhotari

  authored and

  mukesh-ctds

  committed
  4d634a5

  Copy full SHA for 4d634a5

• [fix][broker] Fix OpReadEntry.skipCondition NPE issue (apache#22367)

  Show description for f93142e
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  f93142e

  Copy full SHA for f93142e

• [fix][client] Consumer lost message ack due to race condition in acknowledge with batch message (apache#22353)

  Show description for 8c31dfa
  

  Shawyeok

  authored and

  mukesh-ctds

  committed
  8c31dfa

  Copy full SHA for 8c31dfa

• [fix][test] Fix flaky RGUsageMTAggrWaitForAllMsgsTest (apache#22252)

  Show description for 3c23135
  

  lhotari

  authored and

  mukesh-ctds

  committed
  3c23135

  Copy full SHA for 3c23135

• [fix][broker] Avoid expired unclosed ledgers when checking expired messages by ledger closure time (apache#22335)

  Show description for f7a483e
  

  coderzc

  authored and

  mukesh-ctds

  committed
  f7a483e

  Copy full SHA for f7a483e

• [fix][misc] Make ConcurrentBitSet thread safe (apache#22361)

  Show description for 90ac926
  

  lhotari

  authored and

  mukesh-ctds

  committed
  90ac926

  Copy full SHA for 90ac926

• [improve][client] Add backoff for seek (apache#20963)

  Show description for b60d4a5
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  b60d4a5

  Copy full SHA for b60d4a5

• [fix][client] fix Reader.hasMessageAvailable might return true after seeking to latest (apache#22201)

  Show description for 3c74a67
  

  BewareMyPower

  authored and

  mukesh-ctds

  committed
  3c74a67

  Copy full SHA for 3c74a67

• [fix][broker] Fix wrong double-checked locking for readOnActiveConsumerTask in dispatcher (apache#22279)

  Show description for 5114ba7
  

  BewareMyPower

  authored and

  mukesh-ctds

  committed
  5114ba7

  Copy full SHA for 5114ba7

• [fix][broker] Avoid execute prepareInitPoliciesCacheAsync if namespace is deleted (apache#22268)

  Show description for 88cb234
  

  hanmz

  authored and

  mukesh-ctds

  committed
  88cb234

  Copy full SHA for 88cb234

• [fix][client] Fix wrong results of hasMessageAvailable and readNext after seeking by timestamp (apache#22363)

  Show description for c01a2f3
  

  BewareMyPower

  authored and

  mukesh-ctds

  committed
  c01a2f3

  Copy full SHA for c01a2f3

• [fix][broker] Check cursor state before adding it to the waitingCursors (apache#22191)

  Show description for 8682575
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  8682575

  Copy full SHA for 8682575

• [improve][misc] Remove the call to sun InetAddressCachePolicy (apache#22329)

  Show description for 23835a2
  

  jianyun8023

  authored and

  mukesh-ctds

  committed
  23835a2

  Copy full SHA for 23835a2

• [fix][test][branch-3.0] Fix broken ManagedLedgerTest.testGetNumberOfEntriesInStorage

  Show description for 74cd88c
  

  lhotari

  authored and

  mukesh-ctds

  committed
  74cd88c

  Copy full SHA for 74cd88c

• [fix][test] Fix flaky test BrokerServiceAutoSubscriptionCreationTest (apache#22190)

  Show description for c676866
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  c676866

  Copy full SHA for c676866

• [fix][build] Upgrade alluxio version to 2.9.3 to fix CVE-2023-38889 (apache#21715)

  Show description for 3a1f64d
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  3a1f64d

  Copy full SHA for 3a1f64d

• [improve][misc] Pin Netty version in pulsar-io/alluxio (apache#21728)

  Show description for fda1405
  

  lhotari

  authored and

  mukesh-ctds

  committed
  fda1405

  Copy full SHA for fda1405

• [improve][test][branch-3.0] Improve ManagedLedgerTest.testGetNumberOfEntriesInStorage

  Show description for 6f76a83
  

  lhotari

  authored and

  mukesh-ctds

  committed
  6f76a83

  Copy full SHA for 6f76a83

• [improve] [broker] Avoid repeated Read-and-discard when using Key_Shared mode (apache#22245)

  Show description for 2ff9e98
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  2ff9e98

  Copy full SHA for 2ff9e98

• [fix][broker] Support OIDC providers with JWK without alg field set in keys (apache#22421)

  Show description for 2c9cf30
  

  lhotari

  authored and

  mukesh-ctds

  committed
  2c9cf30

  Copy full SHA for 2c9cf30

• [fix][misc] Rename all shaded Netty native libraries (apache#22415)

  Show description for df88dc1
  

  lhotari

  authored and

  mukesh-ctds

  committed
  df88dc1

  Copy full SHA for df88dc1

• [fix][broker] Fix consumer stops receiving messages when with large backlogs processing (apache#22454)

  Show description for fe4bc49
  

  Technoboy-

  authored and

  mukesh-ctds

  committed
  fe4bc49

  Copy full SHA for fe4bc49

• [admin][broker] Fix force delete subscription not working (apache#22423)

  Show description for 9119643
  

  dao-jun

  authored and

  mukesh-ctds

  committed
  9119643

  Copy full SHA for 9119643

• [improve][io]: Add validation for JDBC sink not supporting primitive schema (apache#22376)

  Show description for 4abea10
  

  shibd

  authored and

  mukesh-ctds

  committed
  4abea10

  Copy full SHA for 4abea10

• [fix][ml] No rollover inactive ledgers when metadata service invalid (apache#22284)

  Show description for 88a9664
  

  AnonHxy

  authored and

  mukesh-ctds

  committed
  88a9664

  Copy full SHA for 88a9664

• [fix][client] Fix client side memory leak when call MessageImpl.create and fix imprecise client-side metrics: pendingMessagesUpDownCounter, pendingBytesUpDownCounter, latencyHistogram (apache#22393)

  Show description for 246f0ee
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  246f0ee

  Copy full SHA for 246f0ee

Commits on Apr 16, 2024

• Remove unused fields msgSize

  Show description for 1065792
  

  BewareMyPower

  authored and

  mukesh-ctds

  committed
  1065792

  Copy full SHA for 1065792

• [improve][misc] Upgrade to Bookkeeper 4.16.5 (apache#22484)

  Show description for 29805a8
  

  lhotari

  authored and

  mukesh-ctds

  committed
  29805a8

  Copy full SHA for 29805a8

• [fix][txn]Handle exceptions in the transaction pending ack init (apache#21274)

  Show description for 7005924
  

  liangyepianzhou

  authored and

  mukesh-ctds

  committed
  7005924

  Copy full SHA for 7005924

• [fix] [broker] Prevent long deduplication cursor backlog so that topic loading wouldn't timeout (apache#22479)

  Show description for fa262d3
  

  poorbarcode

  authored and

  mukesh-ctds

  committed
  fa262d3

  Copy full SHA for fa262d3

• [improve] [broker] Servlet support response compression (apache#21667)

  Show description for 752e83c
  

  hangc0276

  authored and

  mukesh-ctds

  committed
  752e83c

  Copy full SHA for 752e83c

• [improve][test] Replace usage of curl in Java test and fix stream leaks (apache#22463)

  Show description for 085af8d
  

  lhotari

  authored and

  mukesh-ctds

  committed
  085af8d

  Copy full SHA for 085af8d

• [improve][broker] Improve Gzip compression, allow excluding specific paths or disabling it (apache#22370)

  Show description for 68b8d05
  

  lhotari

  authored and

  mukesh-ctds

  committed
  68b8d05

  Copy full SHA for 68b8d05

• [fix][broker] Optimize /metrics, fix unbounded request queue issue and fix race conditions in metricsBufferResponse mode (apache#22494)

  Show description for c7d1521
  

  lhotari

  authored and

  mukesh-ctds

  committed
  c7d1521

  Copy full SHA for c7d1521

• [fix][broker] Create new ledger after the current ledger is closed (apache#22034)

  Show description for eed3d17
  

  liangyepianzhou

  authored and

  mukesh-ctds

  committed
  eed3d17

  Copy full SHA for eed3d17

• [fix][test] Flaky-test: testMessageExpiryWithTimestampNonRecoverableException and testIncorrectClientClock (apache#22489)

  Show description for 4731785
  

  shibd

  authored and

  mukesh-ctds

  committed
  4731785

  Copy full SHA for 4731785

• [fix][sec] Upgrade Bouncycastle to 1.78 (apache#22509)

  Show description for 6963e6b
  

  izumo27

  authored and

  mukesh-ctds

  committed
  6963e6b

  Copy full SHA for 6963e6b

• [fix][io] Kafka Source connector maybe stuck (apache#22511)

  Show description for 8c5ad45
  

  shibd

  authored and

  mukesh-ctds

  committed
  8c5ad45

  Copy full SHA for 8c5ad45

• [improve][broker] backlog quota exceed limit log replaced with debug (apache#22475)

  Show description for d7812b9
  

  mukesh154

  authored and

  mukesh-ctds

  committed
  d7812b9

  Copy full SHA for d7812b9

• Revert "[fix][test][branch-3.0] Fix broken ManagedLedgerTest.testGetNumberOfEntriesInStorage"

  Show description for 877b527
  mukesh-ctds

  committed
  877b527

  Copy full SHA for 877b527

• fix PrometheusMetricsTest.testEscapeLabelValue

  mukesh-ctds

  committed
  6070b4d

  Copy full SHA for 6070b4d

Commits on Apr 19, 2024

• [improve][broker] Add createTopicIfDoesNotExist option to RawReader constructor (apache#22264)

  Show description for 72d6710
  

  coderzc

  authored and

  mukesh-ctds

  committed
  72d6710

  Copy full SHA for 72d6710

• fix

  mukesh-ctds

  committed
  dde20bf

  Copy full SHA for dde20bf