Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OfflineRL #4

Merged
merged 57 commits into from
Sep 30, 2024
Merged
Changes from 1 commit
Commits
Show all changes
57 commits
Select commit Hold shift + click to select a range
7a480ae
init keyboard agent
BY571 May 28, 2024
414b969
add pretrain script for offlineRL
BY571 May 29, 2024
f78b7f5
add iql
BY571 May 30, 2024
c9b9dad
init cql
BY571 May 30, 2024
5eefbfe
add cql
BY571 May 30, 2024
f40f681
Merge branch 'main' into offlinerl
BY571 May 31, 2024
4789324
update random agent
BY571 Jun 4, 2024
063d801
add roboarm eval
BY571 Jun 4, 2024
bee4303
add pretrain roboarm
BY571 Jun 6, 2024
410c3a9
Update eval scripts roboarm walker
BY571 Jun 6, 2024
6e4be42
update keyboard agent
BY571 Jun 18, 2024
f0ffdc1
inint pickplace roboarm env
BY571 Jun 26, 2024
732226b
update pickplace client, roboarm eval
BY571 Jul 3, 2024
b429e9d
update replay buffer saving
BY571 Jul 3, 2024
79a90c6
tanh low high update
BY571 Jul 3, 2024
29dfeb0
Merge branch 'main' into offlinerl
BY571 Jul 3, 2024
5b07957
Merge branch 'imitation_setup' into offlinerl
BY571 Jul 3, 2024
0149606
add pynput install to requirements
BY571 Jul 3, 2024
e9a14e1
update pickplace env and keyboard agent
BY571 Jul 3, 2024
30f0aeb
tests
BY571 Jul 4, 2024
ad38927
update config
BY571 Jul 4, 2024
540edee
Update batched
BY571 Aug 5, 2024
7e0b3ce
set bc default false
BY571 Sep 17, 2024
19568b5
update bc agent buffer loading
BY571 Sep 17, 2024
5a65efc
update agents buffer loading
BY571 Sep 17, 2024
021ae45
update readme with dataset info
BY571 Sep 17, 2024
57ccf27
update roboarm envs with pretrain flag
BY571 Sep 17, 2024
bc4e53e
Update pretrain script with pretrain flag
BY571 Sep 17, 2024
3d802aa
update gitgnore for .pth
BY571 Sep 27, 2024
dd0bc25
take off keyboard agent pickplace
BY571 Sep 27, 2024
2f56409
take off pickplace transform
BY571 Sep 27, 2024
5047954
take off keyboard agent
BY571 Sep 27, 2024
1fc9e83
pretrain docstring
BY571 Sep 27, 2024
d07c5ea
update base_env_sim with use_hub
BY571 Sep 27, 2024
153e00c
take off pretrain from sim envs
BY571 Sep 27, 2024
32add07
update tests
BY571 Sep 27, 2024
f67c052
update agent network creation
BY571 Sep 27, 2024
e1c261b
add mixed obs dummy image shape tests
BY571 Sep 27, 2024
96c5818
udpate dummy mixed obs env for image shape
BY571 Sep 27, 2024
383766b
add cql agent test
BY571 Sep 27, 2024
793d881
update bc agent
BY571 Sep 27, 2024
f19cbcb
add bc tests
BY571 Sep 27, 2024
7614d88
update torchrl version
BY571 Sep 27, 2024
46fc4a6
update req
BY571 Sep 27, 2024
3424192
update formatting agents
BY571 Sep 27, 2024
4182919
format nets
BY571 Sep 27, 2024
64328b7
formatting tests
BY571 Sep 27, 2024
52ef271
update experiment train evals
BY571 Sep 27, 2024
a60ab43
update readme
BY571 Sep 27, 2024
3e41ca8
fix spelling bug pretrain
BY571 Sep 30, 2024
274f4bc
update readme
BY571 Sep 30, 2024
6e1de6a
update docstring
BY571 Sep 30, 2024
aa08ab3
update docstring
BY571 Sep 30, 2024
65c5859
Update device in eval
BY571 Sep 30, 2024
c7e4949
update all agents
BY571 Sep 30, 2024
61c6b95
remove gail
BY571 Sep 30, 2024
0cfa784
Merge branch 'main' into offlinerl
BY571 Sep 30, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
take off keyboard agent pickplace
BY571 committed Sep 27, 2024
commit dd0bc2540cbff32f59d86c4799930afa5d6e21ce
6 changes: 0 additions & 6 deletions conf/agent/keyboard.yaml

This file was deleted.

17 changes: 0 additions & 17 deletions environments/__init__.py
Original file line number Diff line number Diff line change
@@ -1,19 +1,15 @@
import numpy as np
import torch
from torchrl.envs import (
CatFrames,
Compose,
DoubleToFloat,
ObservationNorm,
PermuteTransform,
RewardSum,
ToTensorImage,
TransformedEnv,
VIPRewardTransform,
)

from environments.roboarm_mixed_v0.RoboArmMixedEnv import RoboArmMixedEnv_v0
from environments.roboarm_pickplace_v0.RoboArmPickPlaceEnv import RoboArmPickPlaceEnv_v0
from environments.roboarm_v0.RoboArmEnv import RoboArmEnv_v0
from environments.roboarm_v0.RoboArmSim import RoboArmSimEnv_v0
from environments.runaway_v0.RunAwayEnv import RunAwayEnv_v0
@@ -31,7 +27,6 @@
"roboarm-v0",
"roboarm_mixed-v0",
"roboarm_sim-v0",
"roboarm_pickplace-v0",
]
ALL_ENVS = ALL_2WHEELER_ENVS + ALL_WALKER_ENVS + ALL_ROBOARM_ENVS

@@ -156,17 +151,5 @@ def make(name="RunAway", env_conf=None, pretain=False):
goal_radius=env_conf.goal_radius,
pretain=pretain,
)
elif name == "roboarm_pickplace-v0":
return RoboArmPickPlaceEnv_v0(
max_episode_steps=env_conf.max_episode_steps,
sleep_time=env_conf.sleep_time,
verbose=env_conf.verbose,
reward_signal=env_conf.reward_signal,
camera_id=env_conf.camera_id,
image_size=env_conf.image_size,
target_image_path=env_conf.target_image_path,
use_vip_reward=env_conf.use_vip_reward,
pretain=pretain,
)
else:
print("Environment not found")
247 changes: 0 additions & 247 deletions environments/roboarm_pickplace_v0/RoboArmPickPlaceEnv.py

This file was deleted.

Loading