Code

Multithreaded replication WIP#1454

Code

Draft

meiji163 wants to merge 57 commits intomastergithub/gh-ost:masterfrom meiji163/parallel-replgithub/gh-ost:meiji163/parallel-replCopy head branch name to clipboard

+1,222-757

Commits

Commits on Sep 30, 2024

• WIP.

  arthurschreiber

  committed
  37c1abd

  Copy full SHA for 37c1abd

• Fixes.

  arthurschreiber

  committed
  5d69fd9

  Copy full SHA for 5d69fd9

• Fixups.

  arthurschreiber

  committed
  df29aa8

  Copy full SHA for df29aa8

• Special handling for first job.

  arthurschreiber

  committed
  81a6e6e

  Copy full SHA for 81a6e6e

• Fix deadlocks.

  arthurschreiber

  committed
  b44c6df

  Copy full SHA for b44c6df

• Update docs and simulate changes.

  arthurschreiber

  committed
  55ce5a2

  Copy full SHA for 55ce5a2

Commits on Oct 3, 2024

• start StreamTransaction implementation

  meiji163

  committed
  0d8f39b

  Copy full SHA for 0d8f39b

• add job Coordinator

  meiji163

  committed
  22a4b8c

  Copy full SHA for 22a4b8c

• fix job complete logic

  meiji163

  committed
  3fd6e71

  Copy full SHA for 3fd6e71

Commits on Oct 4, 2024

• add docker compose

  meiji163

  committed
  f209592

  Copy full SHA for f209592

• fix application of applyEvent.writeFunc

  meiji163

  committed
  c6c877e

  Copy full SHA for c6c877e

Commits on Oct 7, 2024

• Send off transaction events as soon as we see a GTID event.

  Show description for b031166
  arthurschreiber

  committed
  b031166

  Copy full SHA for b031166

Commits on Oct 8, 2024

• WIP.

  Show description for f81a790
  

  arthurschreiber

  and

  danieljoos

  committed
  f81a790

  Copy full SHA for f81a790

Commits on Oct 9, 2024

• WIP.

  arthurschreiber

  committed
  e3b2cda

  Copy full SHA for e3b2cda

Commits on Oct 10, 2024

• fix MarkTransactionCompleted

  meiji163

  committed
  3ba9058

  Copy full SHA for 3ba9058

• go mod tidy

  meiji163

  committed
  74f6c9c

  Copy full SHA for 74f6c9c

• configure max idle connections

  meiji163

  committed
  eddc1c9

  Copy full SHA for eddc1c9

• vendor packages

  meiji163

  committed
  6321e73

  Copy full SHA for 6321e73

• track binlog coords

  meiji163

  committed
  5600b91

  Copy full SHA for 5600b91

Commits on Oct 16, 2024

• binlog streamer reconnect

  meiji163

  committed
  3f47ebd

  Copy full SHA for 3f47ebd

• fix TestMigrate

  meiji163

  committed
  e81aabf

  Copy full SHA for e81aabf

Commits on Oct 17, 2024

• worker-stats command

  meiji163

  committed
  e4da5f8

  Copy full SHA for e4da5f8

• setup mysql in CI

  meiji163

  committed
  c5e239c

  Copy full SHA for c5e239c

• set transaction_write_set_extraction in test

  meiji163

  committed
  2e78f6f

  Copy full SHA for 2e78f6f

• add ci mysql opt flags

  meiji163

  committed
  875d00d

  Copy full SHA for 875d00d

• Revert "set transaction_write_set_extraction in test"

  Show description for 9a022e2
  meiji163

  committed
  9a022e2

  Copy full SHA for 9a022e2

• change ci mysql opts

  meiji163

  committed
  18dcee1

  Copy full SHA for 18dcee1

• try custom docker run

  meiji163

  committed
  299df37

  Copy full SHA for 299df37

Commits on Oct 21, 2024

• Make the linter happy.

  arthurschreiber

  committed
  941689f

  Copy full SHA for 941689f

• Use testcontainers.

  arthurschreiber

  committed
  9e3bc1c

  Copy full SHA for 9e3bc1c

• WIP.

  arthurschreiber

  committed
  113e674

  Copy full SHA for 113e674

• Merge branch 'master' of https://github.com/github/gh-ost into meiji163/parallel-repl

  arthurschreiber

  committed
  8e38b86

  Copy full SHA for 8e38b86

• Merge branch 'master' of https://github.com/github/gh-ost into meiji163/parallel-repl

  arthurschreiber

  committed
  d7ccab9

  Copy full SHA for d7ccab9

• fix 2 tests, TestMigrate still not working

  meiji163

  committed
  06c7082

  Copy full SHA for 06c7082

• Fix applier tests.

  arthurschreiber

  committed
  d7dc97b

  Copy full SHA for d7dc97b

• Fix migrator tests.

  arthurschreiber

  committed
  bcc7e7a

  Copy full SHA for bcc7e7a

• Add error assertions.

  arthurschreiber

  committed
  b747d98

  Copy full SHA for b747d98

• 🔥

  arthurschreiber

  committed
  1a5be0b

  Copy full SHA for 1a5be0b

Commits on Oct 22, 2024

• Fix applier connection pool size.

  arthurschreiber

  committed
  1942455

  Copy full SHA for 1942455

Commits on Oct 23, 2024

• Merge branch 'master' into meiji163/parallel-repl

  arthurschreiber

  authored
  85cab4d

  Copy full SHA for 85cab4d

• Fix merge conflict.

  arthurschreiber

  committed
  2ba0cb2

  Copy full SHA for 2ba0cb2

• Prepare queries.

  arthurschreiber

  committed
  b82e8f9

  Copy full SHA for b82e8f9

Commits on Oct 24, 2024

• pass throttler to Coordinator

  meiji163

  committed
  fa7c484

  Copy full SHA for fa7c484

• track time waiting on event channels

  meiji163

  committed
  126c981

  Copy full SHA for 126c981

Commits on Oct 25, 2024

• add flag for number of Coordinator workers

  meiji163

  committed
  641fe92

  Copy full SHA for 641fe92

• Merge branch 'master' of https://github.com/github/gh-ost into meiji163/parallel-repl

  arthurschreiber

  committed
  615d1df

  Copy full SHA for 615d1df

• Fix test case.

  arthurschreiber

  committed
  0a8787e

  Copy full SHA for 0a8787e

Commits on Nov 18, 2024

• Merge branch 'master' into meiji163/parallel-repl

  meiji163

  authored
  6aaa374

  Copy full SHA for 6aaa374

• remove unused streamer

  meiji163

  committed
  f6ec835

  Copy full SHA for f6ec835

• fix coordinator test

  meiji163

  committed
  0555d72

  Copy full SHA for 0555d72

• Merge branch 'master' into meiji163/parallel-repl

  meiji163

  committed
  569d035

  Copy full SHA for 569d035

Commits on Nov 19, 2024

• fix Coordinator test

  meiji163

  committed
  9b5e2bc

  Copy full SHA for 9b5e2bc

• fix migrator test

  meiji163

  committed
  6689aeb

  Copy full SHA for 6689aeb

• linter fix

  meiji163

  committed
  53e953d

  Copy full SHA for 53e953d

Commits on Nov 22, 2024

• Merge branch 'master' into meiji163/parallel-repl

  meiji163

  authored
  e1ca9cd

  Copy full SHA for e1ca9cd

Commits on Dec 19, 2024

• Merge branch 'master' into meiji163/parallel-repl

  meiji163

  committed
  b34f2e2

  Copy full SHA for b34f2e2

• Merge branch 'master' into meiji163/parallel-repl

  meiji163

  authored
  adfcdf7

  Copy full SHA for adfcdf7