You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+138-4Lines changed: 138 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -29,6 +29,7 @@ OpenTryOn is an open-source AI toolkit designed for fashion technology and virtu
29
29
- GPT-Image-1 & GPT-Image-1.5 (OpenAI): High-quality image generation with strong prompt understanding, consistent composition, and reliable visual accuracy. GPT-Image-1.5 offers enhanced quality and better consistency
30
30
-**Video Generation**:
31
31
- Luma AI Video Generation Model (Dream Machine): High-quality video generation with text-to-image and image-to-video modes.
32
+
- Google Veo 3 Video Generation Model: Generate high-quality, cinematic videos from text or images with realistic motion, temporal consistency, and fine-grained control over style and camera dynamics.
32
33
-**Datasets Module**:
33
34
- Fashion-MNIST dataset loader with automatic download
34
35
- VITON-HD dataset loader with lazy loading via PyTorch DataLoader
@@ -61,6 +62,7 @@ OpenTryOn is an open-source AI toolkit designed for fashion technology and virtu
61
62
-[Image Generation with Luma AI](#luma-ai-image-generation)
62
63
-[Image Generation with OpenAI](#image-generation-with-gpt-image-1)
63
64
-[Video Generation with Luma AI](#video-generation-with-luma-ai)
65
+
-[Video Generation with Google Veo 3](#video-generation-with-google-veo-3)
@@ -138,13 +140,13 @@ KLING_AI_BASE_URL=https://api-singapore.klingai.com # Optional, defaults to Sin
138
140
# Segmind Credentials (required for Segmind virtual try-on)
139
141
SEGMIND_API_KEY=your_segmind_api_key
140
142
141
-
# Google Gemini Credentials (required for Nano Banana image generation)
143
+
# Google Gemini Credentials (required for Nano Banana image generation and Google Veo 3 Video generation)
142
144
GEMINI_API_KEY=your_gemini_api_key
143
145
144
146
# BFL API Credentials (required for FLUX.2 image generation)
145
147
BFL_API_KEY=your_bfl_api_key
146
148
147
-
# Luma AI Credentials (required for Luma AI image generation)
149
+
# Luma AI Credentials (required for Luma AI image generation and Luma AI Video generation)
148
150
LUMA_AI_API_KEY=your_luma_ai_api_key
149
151
150
152
# OpenAI Credentials (required for OpenAI GPT-Image-1 image generation)
@@ -164,7 +166,7 @@ GOOGLE_API_KEY=your_google_api_key # For Google Gemini
164
166
- For Kling AI, obtain your API key and secret key from the [Kling AI Developer Portal](https://app.klingai.com/global/dev/document-api/apiReference/model/functionalityTry)
165
167
166
168
- For Segmind, obtain your API key from the [Segmind API Portal](https://www.segmind.com/models/try-on-diffusion/api)
167
-
- For Nano Banana, obtain your API key from the [Google AI Studio](https://aistudio.google.com/app/apikey)
169
+
- For Nano Banana and Google Veo 3, obtain your API key from the [Google AI Studio](https://aistudio.google.com/app/apikey)
168
170
- For FLUX.2 models, obtain your API key from [BFL AI](https://docs.bfl.ai/)
169
171
170
172
- For FLUX.2 models, obtain your API key from [BFL AI](https://docs.bfl.ai/)
@@ -1621,7 +1623,7 @@ for idx, vid_bytes in enumerate(video_list):
1621
1623
1622
1624
#### Supported Features
1623
1625
1624
-
-**Text to Video**: Generate videos using test descriptions.
1626
+
-**Text to Video**: Generate videos using text descriptions.
1625
1627
-**Image to Video**: Generate videos using keyframes.
1626
1628
-**Keyframe Generation**: Generate videos using a start keyframe or an end keyframe or both.
1627
1629
-**Duration**: Durations in seconds (5s, 9s, 10s)
@@ -1639,6 +1641,138 @@ for idx, vid_bytes in enumerate(video_list):
1639
1641
1640
1642
**Reference**: [Luma AI Video Generation Documentation](https://docs.lumalabs.ai/docs/video-generation)
1641
1643
1644
+
### Video Generation with Google Veo 3
1645
+
1646
+
Generate high-quality, cinematic videos using Google’s Veo 3 models (Veo 3.0 and Veo 3.1), including (veo-3.1-generate-preview, veo-3.1-fast-generate-preview, veo-3.0-generate-001, and veo-3.0-fast-generate-001). These models support text-to-video, image-to-video, reference-images-to-video, and frames-to-video generation for controlled motion, realistic dynamics, and consistent visual quality.
1647
+
1648
+
#### Prerequisites
1649
+
1650
+
1.**Google Gemini Account Setup**:
1651
+
- Sign up for a Google AI Studio account at [Google AI Studio](https://aistudio.google.com/)
1652
+
- Obtain your API key from the [API Keys page](https://aistudio.google.com/app/apikey)
1653
+
- Configure credentials in your `.env` file (see Environment Variables section)
1654
+
1655
+
2.**Model Selection**:
1656
+
-**veo-3.1-generate-preview**: Generate high-quality cinematic videos with enhanced motion realism and temporal consistency using the latest Veo 3.1 model.
1657
+
-**veo-3.1-fast-generate-preview**: Create videos quickly with optimized inference speed while retaining strong visual quality and motion coherence.
1658
+
-**veo-3.0-generate-001**: Produce stable, high-fidelity videos using the proven Veo 3.0 generation model with reliable motion and style control.
1659
+
-**veo-3.0-fast-generate-001**: Generate videos faster with the Veo 3.0 fast variant, balancing speed and visual quality for rapid iteration.
1660
+
1661
+
#### Command Line Usage
1662
+
1663
+
```bash
1664
+
# Text to Video with Google Veo 3
1665
+
python veo_video.py --provider veo-3.1-generate-preview --mode text --prompt "model at a fashion show" --aspect 16:9 --duration 8 --resolution 1080p --output_dir outputs
1666
+
1667
+
# Video generation with negative prompt
1668
+
python veo_video.py --provider veo-3.1-generate-preview --mode text --prompt "person with a hat" --resolution 1080p --negative_prompt "cartoon, anime, kids"
1669
+
1670
+
# Image to Video
1671
+
python veo_video.py --provider veo-3.1-generate-preview --mode image --prompt "model at a fashion show" --images person.jpg --aspect 16:9 --duration 8 --resolution 1080p
1672
+
1673
+
# Video generation with reference images (up to 3)
0 commit comments