Downloading dataset is slow

[xjtunzy]

The dataset download is too slow.May I ask what methods can be used to solve this problem?

2026-03-15 21:27:45.557 | WARNING | objaverse.xl.sketchfab:_parallel_download_object:356 - Failed to download https://sketchfab.com/3d-models/4dc9912d785d46ee8bed798fecc5280e: <urlopen error [Errno 110] Connection timed out>
0%|▏ | 80/83758 [34:25<181:07:12, 7.79s/it]
2026-03-15 21:28:46.997 | WARNING | objaverse.xl.sketchfab:_parallel_download_object:356 - Failed to download https://sketchfab.com/3d-models/0ebe0b71741b4655890976cf9c68c019: <urlopen error [Errno 110] Connection timed out>
0%|▏ | 83/83758 [35:27<287:45:28, 12.38s/it]

[smileyenot983]

for github subset it's even slower...

[SGMorford]

I used:
(trellis) D:\3D\TRELLIS>python dataset_toolkits/download.py ObjaverseXL --output_dir F:/datasets/ObjaverseXL_sketchfab --world_size 160000
Processing 1 objects...
2026-04-25 14:07:42.036 | INFO | objaverse.xl.github:_get_annotations:65 - Downloading https://huggingface.co/datasets/allenai/objaverse-xl/resolve/main/github/github.parquet to ~/.objaverse\github\github.parquet
2026-04-25 14:08:56.255 | INFO | objaverse.xl.thingiverse:get_annotations:46 - Downloading https://huggingface.co/datasets/allenai/objaverse-xl/resolve/main/thingiverse/thingiverse.parquet to ~/.objaverse\thingiverse\thingiverse.parquet
2026-04-25 14:09:29.444 | INFO | objaverse.xl.smithsonian:get_annotations:47 - Downloading https://huggingface.co/datasets/allenai/objaverse-xl/resolve/main/smithsonian/smithsonian.parquet to ~/.objaverse\smithsonian\smithsonian.parquet
2026-04-25 14:09:30.076 | INFO | objaverse.xl.sketchfab:_get_annotations:52 - Downloading https://huggingface.co/datasets/allenai/objaverse-xl/resolve/main/sketchfab/sketchfab.parquet to ~/.objaverse\sketchfab\sketchfab.parquet
2026-04-25 14:09:42.476 | INFO | objaverse.xl.sketchfab:download_objects:508 - Found 0 objects already downloaded
2026-04-25 14:09:42.477 | INFO | objaverse.xl.sketchfab:download_objects:529 - Downloading 1 new objects across 6 processes
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:02<00:00, 2.41s/it]
Went fairly quick...

[smileyenot983]

I used: (trellis) D:\3D\TRELLIS>python dataset_toolkits/download.py ObjaverseXL --output_dir F:/datasets/ObjaverseXL_sketchfab --world_size 160000 Processing 1 objects... 2026-04-25 14:07:42.036 | INFO | objaverse.xl.github:_get_annotations:65 - Downloading https://huggingface.co/datasets/allenai/objaverse-xl/resolve/main/github/github.parquet to ~/.objaverse\github\github.parquet 2026-04-25 14:08:56.255 | INFO | objaverse.xl.thingiverse:get_annotations:46 - Downloading https://huggingface.co/datasets/allenai/objaverse-xl/resolve/main/thingiverse/thingiverse.parquet to ~/.objaverse\thingiverse\thingiverse.parquet 2026-04-25 14:09:29.444 | INFO | objaverse.xl.smithsonian:get_annotations:47 - Downloading https://huggingface.co/datasets/allenai/objaverse-xl/resolve/main/smithsonian/smithsonian.parquet to ~/.objaverse\smithsonian\smithsonian.parquet 2026-04-25 14:09:30.076 | INFO | objaverse.xl.sketchfab:_get_annotations:52 - Downloading https://huggingface.co/datasets/allenai/objaverse-xl/resolve/main/sketchfab/sketchfab.parquet to ~/.objaverse\sketchfab\sketchfab.parquet 2026-04-25 14:09:42.476 | INFO | objaverse.xl.sketchfab:download_objects:508 - Found 0 objects already downloaded 2026-04-25 14:09:42.477 | INFO | objaverse.xl.sketchfab:download_objects:529 - Downloading 1 new objects across 6 processes 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:02<00:00, 2.41s/it] Went fairly quick...

Looks like only 1 object was downloaded. It is slow if one wants to download whole dataset.