Skip to content

Commit d4ca28a

Browse files
marc-rigterMarc Rigter
andauthored
Updated to "Release of AVID" (#109)
Co-authored-by: Marc Rigter <t-marcrigter@microsoft.com>
1 parent 07de467 commit d4ca28a

178 files changed

Lines changed: 34192 additions & 1 deletion

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

pyproject.toml

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[tool.poetry]
22
name = "causica"
3-
version = "0.4.2"
3+
version = "0.4.3"
44
description = ""
55
readme = "README.md"
66
authors = ["Microsoft Research - Causica"]
@@ -69,8 +69,15 @@ junit_family = "xunit1"
6969

7070
[tool.mypy]
7171
ignore_missing_imports = true
72+
exclude = [
73+
"research_experiments/avid"
74+
]
7275

7376
[tool.pylint.main]
77+
ignore-paths = [
78+
"research_experiments/avid/latent_diffusion/libs",
79+
]
80+
7481
# Specify a score threshold to be exceeded before program exits with error.
7582
fail-under = 9.94
7683
# Use multiple processes to speed up Pylint. Specifying 0 will auto-detect the
Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
# Adapting Video Diffusion Models to World Models
2+
### Marc Rigter, Tarun Gupta, Agrin Hilmkil and Chao Ma
3+
4+
[![Project Page](https://img.shields.io/badge/Project%20Page-green)](https://sites.google.com/view/avid-world-model-adapters/home)
5+
6+
<p float="left">
7+
<img src="images/rt1_1.gif" width="142" />
8+
<img src="images/rt1_2.gif" width="142" />
9+
<img src="images/rt1_3.gif" width="142" />
10+
<img src="images/rt1_4.gif" width="142" />
11+
<img src="images/rt1_5.gif" width="142" />
12+
</p>
13+
<p float="left">
14+
<img src="images/coinrun1.gif" width="100" />
15+
<img src="images/coinrun2.gif" width="100" />
16+
<img src="images/coinrun3.gif" width="100" />
17+
<img src="images/coinrun4.gif" width="100" />
18+
<img src="images/coinrun5.gif" width="100" />
19+
<img src="images/coinrun6.gif" width="100" />
20+
<img src="images/coinrun7.gif" width="100" />
21+
</p>
22+
23+
Official code to reproduce the experiments for ["Adapting Video Diffusion Models to World Models"](https://sites.google.com/view/avid-world-model-adapters/home) (AVID), which proposes to adapt pretrained video diffusion models to action-conditioned world models.
24+
25+
AVID is implemented using both pixel-space diffusion and latent space diffusion. For instructions on how to use each of the codebases, please see [pixel_diffusion/README.md](pixel_diffusion/README.md) and [latent_diffusion/README.md](latent_diffusion/README.md). Results are logged to Weights and Biases.
26+
27+
28+
### Acknowledgements
29+
30+
This project utilises code from [video-diffusion-pytorch](https://github.com/lucidrains/video-diffusion-pytorch), [DynamiCrafter](https://github.com/Doubiiu/DynamiCrafter), and [octo](https://github.com/octo-models/octo).
131 KB
Loading
104 KB
Loading
161 KB
Loading
74.2 KB
Loading
102 KB
Loading
141 KB
Loading
125 KB
Loading
1.24 MB
Loading

0 commit comments

Comments
 (0)