Code

Feat/prepare twitch part3#239

Code

Draft

araffin wants to merge 105 commits intomasterDLR-RM/rl-baselines3-zoo:masterfrom feat/prepare-twitch-part3DLR-RM/rl-baselines3-zoo:feat/prepare-twitch-part3Copy head branch name to clipboard

+5,557-1,303

Commits

Commits on Oct 31, 2020

• Add Offline-RL support

  araffin

  committed
  182e3d4

  Copy full SHA for 182e3d4

• Deactivate logging for offline RL

  araffin

  committed
  a165b73

  Copy full SHA for a165b73

Commits on Nov 29, 2020

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  3ab448e

  Copy full SHA for 3ab448e

• Update d3rlpy wrapper

  araffin

  committed
  49f1c4e

  Copy full SHA for 49f1c4e

Commits on Feb 7, 2021

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  c8cff9f

  Copy full SHA for c8cff9f

Commits on Feb 14, 2021

• Update hyperparams

  araffin

  committed
  569d4b4

  Copy full SHA for 569d4b4

• Update buffer size

  araffin

  committed
  b926f9d

  Copy full SHA for b926f9d

• Add support for residual RL

  araffin

  committed
  fee7909

  Copy full SHA for fee7909

Commits on Feb 15, 2021

• Update README

  araffin

  committed
  cd5e4b4

  Copy full SHA for cd5e4b4

Commits on Feb 16, 2021

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  a1d6094

  Copy full SHA for a1d6094

Commits on Feb 22, 2021

• test with ppo

  araffin

  committed
  2e8a072

  Copy full SHA for 2e8a072

Commits on Feb 23, 2021

• Update d3rlpy

  araffin

  committed
  4fc0864

  Copy full SHA for 4fc0864

• Fix for CRR

  araffin

  committed
  d335335

  Copy full SHA for d335335

Commits on Feb 24, 2021

• Fix pushed to d3rlpy

  araffin

  committed
  49909ef

  Copy full SHA for 49909ef

Commits on Feb 26, 2021

• Handle keyboard interrupt

  araffin

  committed
  fefc3bd

  Copy full SHA for fefc3bd

Commits on Feb 28, 2021

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  a2dd644

  Copy full SHA for a2dd644

• Upgrade SB3 + add d3rlpy as requirement

  araffin

  committed
  03e682d

  Copy full SHA for 03e682d

• Add CMAES

  araffin

  committed
  87b65aa

  Copy full SHA for 87b65aa

• Fixes

  araffin

  committed
  0f7fd0d

  Copy full SHA for 0f7fd0d

• Copy to avoid modification by reference

  araffin

  committed
  d24842e

  Copy full SHA for d24842e

Commits on Mar 1, 2021

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  a9a45f4

  Copy full SHA for a9a45f4

• Start support for d3rlpy

  araffin

  committed
  c1dea20

  Copy full SHA for c1dea20

• Add net_arch for BC

  araffin

  committed
  df80a26

  Copy full SHA for df80a26

• Bug fixes

  araffin

  committed
  a4d1c8b

  Copy full SHA for a4d1c8b

• Use best candidate only once

  araffin

  committed
  8c98c3c

  Copy full SHA for 8c98c3c

Commits on Apr 5, 2021

• Remove HER

  araffin

  committed
  c963be2

  Copy full SHA for c963be2

• Add basic support for refactored HER

  araffin

  committed
  40ce4c5

  Copy full SHA for 40ce4c5

Commits on Apr 7, 2021

• Add TQC

  araffin

  committed
  7fad104

  Copy full SHA for 7fad104

Commits on Apr 14, 2021

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  da56dff

  Copy full SHA for da56dff

Commits on Apr 19, 2021

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  7105a55

  Copy full SHA for 7105a55

Commits on Apr 20, 2021

• Integrate RL Racing

  araffin

  committed
  f6b9b43

  Copy full SHA for f6b9b43

Commits on Apr 26, 2021

• Use TQC

  araffin

  committed
  03af926

  Copy full SHA for 03af926

Commits on Apr 27, 2021

• Add space engineer env

  araffin

  committed
  b4d26c9

  Copy full SHA for b4d26c9

Commits on Apr 29, 2021

• Merge branch 'master' into refactor/her

  araffin

  committed
  76b40d6

  Copy full SHA for 76b40d6

• Update hyperparams

  araffin

  committed
  e7e9ee6

  Copy full SHA for e7e9ee6

• Fix hyperparam

  araffin

  committed
  ae706eb

  Copy full SHA for ae706eb

Commits on May 3, 2021

• Merge branch 'master' into refactor/her

  araffin

  committed
  d079811

  Copy full SHA for d079811

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  3dad1ed

  Copy full SHA for 3dad1ed

Commits on May 4, 2021

• Removed unused callback

  araffin

  committed
  73bea6e

  Copy full SHA for 73bea6e

• Update CI

  araffin

  committed
  7e96e10

  Copy full SHA for 7e96e10

• Add partial support for parallel training

  araffin

  committed
  7c4f1bc

  Copy full SHA for 7c4f1bc

• Merge branch 'feat/parallel-train' into feat/offline-RL

  araffin

  committed
  cfa30b5

  Copy full SHA for cfa30b5

Commits on May 5, 2021

• Try parallel training

  araffin

  committed
  5f7980f

  Copy full SHA for 5f7980f

• Cleanup

  araffin

  committed
  b635157

  Copy full SHA for b635157

• Merge branch 'feat/parallel-train' into feat/offline-RL

  araffin

  committed
  55ad418

  Copy full SHA for 55ad418

• Add notes

  araffin

  committed
  76ea2ea

  Copy full SHA for 76ea2ea

• Avoid modify by reference + add sleep time

  araffin

  committed
  2966689

  Copy full SHA for 2966689

• Merge branch 'feat/parallel-train' into feat/offline-RL

  araffin

  committed
  5f9e044

  Copy full SHA for 5f9e044

Commits on May 6, 2021

• Take learning starts into account

  araffin

  committed
  aa6d934

  Copy full SHA for aa6d934

• Merge branch 'feat/parallel-train' into feat/offline-RL

  araffin

  committed
  c2baee5

  Copy full SHA for c2baee5

Commits on May 10, 2021

• Merge branch 'master' into misc/veridream

  araffin

  committed
  76ecb24

  Copy full SHA for 76ecb24

• Merge branch 'feat/parallel-train' into misc/veridream

  araffin

  committed
  54d5596

  Copy full SHA for 54d5596

Commits on May 11, 2021

• Update hyperparams

  araffin

  committed
  563d853

  Copy full SHA for 563d853

• Add dict obs support

  araffin

  committed
  779c4c6

  Copy full SHA for 779c4c6

Commits on May 12, 2021

• Update test env

  araffin

  committed
  43188ad

  Copy full SHA for 43188ad

• Merge branch 'master' into refactor/her

  araffin

  committed
  20c5dd8

  Copy full SHA for 20c5dd8

• Version bump

  araffin

  committed
  b461048

  Copy full SHA for b461048

• Merge branch 'refactor/her' into misc/veridream

  araffin

  committed
  15c8fa1

  Copy full SHA for 15c8fa1

• Merge branch 'master' into misc/veridream

  araffin

  committed
  4857bca

  Copy full SHA for 4857bca

Commits on May 14, 2021

• Update for symmetric control + catch zmq error

  araffin

  committed
  f73a65e

  Copy full SHA for f73a65e

Commits on May 15, 2021

• Save best model

  araffin

  committed
  da441b8

  Copy full SHA for da441b8

Commits on May 16, 2021

• Fix parallel save (maybe issue with optimizer)

  araffin

  committed
  bf05e92

  Copy full SHA for bf05e92

• Update hyperparams

  araffin

  committed
  a9d63db

  Copy full SHA for a9d63db

Commits on May 17, 2021

• Update best params

  araffin

  committed
  d395120

  Copy full SHA for d395120

Commits on May 19, 2021

• Update hyperparams

  araffin

  committed
  5634128

  Copy full SHA for 5634128

• Prepare big network experiment

  araffin

  committed
  c5b7f55

  Copy full SHA for c5b7f55

• Revert to normal net

  araffin

  committed
  976833d

  Copy full SHA for 976833d

• Add exception for windows

  araffin

  committed
  c6b2dce

  Copy full SHA for c6b2dce

• Update plot script: allow multiple envs

  araffin

  committed
  6703390

  Copy full SHA for 6703390

Commits on May 21, 2021

• Add bert params

  araffin

  committed
  a771249

  Copy full SHA for a771249

Commits on May 26, 2021

• Save multirobot hyperparams

  araffin

  committed
  c966371

  Copy full SHA for c966371

Commits on May 27, 2021

• Merge branch 'master' into misc/veridream

  araffin

  committed
  f6f3dd0

  Copy full SHA for f6f3dd0

Commits on May 29, 2021

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  7f24273

  Copy full SHA for 7f24273

• Remove CMAES

  araffin

  committed
  7dc1b3a

  Copy full SHA for 7dc1b3a

• Merge branch 'misc/veridream' into feat/offline-RL

  araffin

  committed
  1f75be3

  Copy full SHA for 1f75be3

• Update params for newer machine

  araffin

  committed
  61925cb

  Copy full SHA for 61925cb

• Re-add timelimit

  araffin

  committed
  fe58ab0

  Copy full SHA for fe58ab0

• Re-add monitor

  araffin

  committed
  9b71984

  Copy full SHA for 9b71984

Commits on May 30, 2021

• Add POC for VecEnvWrapper

  araffin

  committed
  9065a2a

  Copy full SHA for 9065a2a

• Update params

  araffin

  committed
  6cc8256

  Copy full SHA for 6cc8256

Commits on Jun 21, 2021

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  fedbde7

  Copy full SHA for fedbde7

Commits on Jun 29, 2021

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  80f4df1

  Copy full SHA for 80f4df1

• Fixes

  araffin

  committed
  a8d25b3

  Copy full SHA for a8d25b3

• Format

  araffin

  committed
  5530171

  Copy full SHA for 5530171

• Fix loading

  araffin

  committed
  a2244f0

  Copy full SHA for a2244f0

Commits on Jan 4, 2022

• Cleanup hyperparams

  araffin

  committed
  ab98711

  Copy full SHA for ab98711

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  57c0d50

  Copy full SHA for 57c0d50

Commits on Jan 7, 2022

• Sync vec normalize for parallel training

  araffin

  committed
  df89b55

  Copy full SHA for df89b55

• Update params

  araffin

  committed
  da26cb9

  Copy full SHA for da26cb9

Commits on Jan 8, 2022

• Add episode length plot

  araffin

  committed
  3655b90

  Copy full SHA for 3655b90

Commits on Jan 10, 2022

• Add hack when VecNormalize was not saved

  araffin

  committed
  24d3f89

  Copy full SHA for 24d3f89

• Merge branch 'feat/offline-RL' of github.com:DLR-RM/rl-baselines3-zoo into feat/offline-RL

  araffin

  committed
  053f3b4

  Copy full SHA for 053f3b4

Commits on Jan 12, 2022

• Add websocket wait

  araffin

  committed
  a5832e4

  Copy full SHA for a5832e4

Commits on Jan 15, 2022

• Fix bool conversion

  araffin

  committed
  54cc4d0

  Copy full SHA for 54cc4d0

Commits on Jan 19, 2022

• Merge branch 'master' into feat/offline-RL

  araffin

  committed
  a4e37d1

  Copy full SHA for a4e37d1

Commits on Apr 5, 2022

• Save edits from live

  araffin

  committed
  3e2761e

  Copy full SHA for 3e2761e

• Merge branch 'master' into feat/live-twitch

  araffin

  committed
  988bf7b

  Copy full SHA for 988bf7b

Commits on Apr 9, 2022

• Save new callback and wrapper

  araffin

  committed
  6497088

  Copy full SHA for 6497088

Commits on Apr 11, 2022

• Disable continuity wrapper and add expln trick

  araffin

  committed
  6a2dc31

  Copy full SHA for 6a2dc31

Commits on Apr 12, 2022

• Merge remote-tracking branch 'origin/master' into feat/prepare-twitch-part3

  araffin

  committed
  75c4054

  Copy full SHA for 75c4054

Commits on Apr 17, 2022

• Update default

  araffin

  committed
  5cb5e1d

  Copy full SHA for 5cb5e1d

Commits on Apr 20, 2022

• Save edits from live

  araffin

  committed
  987e34d

  Copy full SHA for 987e34d

Commits on Apr 21, 2022

• Flush only when new lap is detected

  araffin

  committed
  c7f218f

  Copy full SHA for c7f218f

• Update sac params

  araffin

  committed
  d415090

  Copy full SHA for d415090

Commits on Jun 3, 2022

• Merge branch 'master' into feat/prepare-twitch-part3

  araffin

  committed
  de982ba

  Copy full SHA for de982ba