A unity interaction project with the StreamDiffusion backend
-
Enable Git LFS: git lfs install
-
Clone this repository: git clone --recurse-submodules https://github.com/code-2-art/streamdiffusion_unity.git
You may also update submodules later: git clone https://github.com/code-2-art/streamdiffusion_unity.git git submodule update --init
-
Configure streamdiffusion (submodule in StreamAssets/streamdiffusion) as introduced in: https://github.com/cumulo-autumn/StreamDiffusion/blob/main/README.md#installation
-
Copy envrionment folder (e.g., /envs/streamdiffusion) to StreamAssets/envs/streamdiffusion
-
Open SampleScene.unity and enjoy the risk on your own! When "Acceleration" is "tensorrt", the system will halt for a long time to generate native engine data. Please be patient. For Graphics cards with low memory, change "Acceleration" from "tensorrt" to "xformers" in Unity Inspector