Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update #1

Merged
merged 52 commits into from
Nov 8, 2023
Merged

update #1

merged 52 commits into from
Nov 8, 2023

Conversation

ZihanDai
Copy link
Owner

@ZihanDai ZihanDai commented Nov 8, 2023

No description provided.

Qwasser and others added 30 commits April 7, 2022 18:25
Error caused by the recent upgrade of the `importlib-metadata`. 4 Oct, 2022.
* Adding new blog

It is adding a new blog that summarises week 05 based on the provided materials for this week.

* Update README.md

* Update README.md

Co-authored-by: Dmitry Nikulin <[email protected]>
* Downloading & Install `xvfb` for video game recording

Fixed the error of `bash: ../xvfb: No such file or directory`, and now the videos are working on Colab and any server.

* Remove incorrect comment

Co-authored-by: Dmitry Nikulin <[email protected]>
Update week03: gym -> gymnasium, renew points, merge notebooks
* fix regret calculation in week5

* fix regret formula
Multiprocessing in Python works differently on Windows and on Linux.
On Windows it copies the objects and in Linux it doesn't.
As a result, some code that works fine on Linux may not work on Windows.
E.g. in our A2C homework we use lambda functions.
Lambda functions are not serializable, so object copying during multiprocessing would fail on Windows.
As for MacOS, it can behave like Linux or like Windows depending on settings.

In this commit I added an instruction that will make the multiprocessing behave like Linux
* Support gym 0.26

There are changes in gym API between 0.25 and 0.26
These changes break backward compatibility.

In this commit we updated the code of week6 seminar to use gym 0.26

What is changed:
- env initializer;
- env.render;
- env.reset;
- env.step;
- video recording

Note: didn't test in Colab, only locally

* week6 seminar: Uppdate video dependencies for Colab

* week6 seminar: minor fix in installing
laktionov and others added 22 commits June 25, 2023 14:41
The link in README.md and the ipynb notebook was pointing to an unavailable resource, leading to a broken user experience.

This commit resolves the issue by updating the link to a valid URL, ensuring users can access the intended resource without any problems.

Changes Made:
- Fixed broken link in README.md
- Fixed broken link in ipynb notebook

Fixes #529
* migrate to gymnasium

* small fix of env.reset()
* migrate to gymnasium

* minor fixes

* use get_wrapper_attr to get writer

* return SummariesBase and NumpySummaries, refactor summaries classes

* torch.long -> torch.int64

* swap width and height in ImagePreprocessing, fix order in SwapImageAxes

* fix SwapImageAxes description

* fix cv2.resize arguments
* migrate mcts to gymnasium

* change name

* rm reset() arguments

* delete redundant import, add comments
* add gymnasium interfaces to py files

* migrate trpo to gymnasium

* migrate ppo to gymnasium

* migrate continuous control hw to gymnasium

* fix super()

* fix code

* fix typo in hw-continuous-control_pytorch.ipynb

* fix termination and truncation processing

* return done
* reset = terminated or truncated

* reset = terminated or truncated
Remove `graph_size` argument from plot_graph()
@ZihanDai ZihanDai merged commit 081aade into ZihanDai:master Nov 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.