Skip to content

PI05 run compute_nome_stats #948

@XRRRRJ

Description

@XRRRRJ

Traceback (most recent call last):
File "/data1/xrj/openpi/scripts/compute_norm_stats.py", line 117, in
tyro.cli(main)
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/tyro/_cli.py", line 229, in cli
return run_with_args_from_cli()
^^^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/scripts/compute_norm_stats.py", line 98, in main
data_loader, num_batches = create_torch_dataloader(
^^^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/scripts/compute_norm_stats.py", line 34, in create_torch_dataloader
dataset = _data_loader.create_torch_dataset(data_config, action_horizon, model_config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/src/openpi/training/data_loader.py", line 141, in create_torch_dataset
dataset = lerobot_dataset.LeRobotDataset(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/lerobot/common/datasets/lerobot_dataset.py", line 499, in init
self.hf_dataset = self.load_hf_dataset()
^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/lerobot/common/datasets/lerobot_dataset.py", line 620, in load_hf_dataset
hf_dataset = load_dataset("parquet", data_dir=path, split="train")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/datasets/load.py", line 2084, in load_dataset
builder_instance.download_and_prepare(
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/datasets/builder.py", line 925, in download_and_prepare
self._download_and_prepare(
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/datasets/builder.py", line 979, in _download_and_prepare
split_generators = self._split_generators(dl_manager, **split_generators_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/datasets/packaged_modules/parquet/parquet.py", line 60, in _split_generators
self.info.features = datasets.Features.from_arrow_schema(pq.read_schema(f))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/datasets/features/features.py", line 1850, in from_arrow_schema
metadata_features = Features.from_dict(metadata["info"]["features"])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/datasets/features/features.py", line 1888, in from_dict
obj = generate_from_dict(dic)
^^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/datasets/features/features.py", line 1468, in generate_from_dict
return {key: generate_from_dict(value) for key, value in obj.items()}
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/datasets/features/features.py", line 1468, in
return {key: generate_from_dict(value) for key, value in obj.items()}
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data1/xrj/openpi/.venv/lib/python3.11/site-packages/datasets/features/features.py", line 1474, in generate_from_dict
raise ValueError(f"Feature type '{_type}' not found. Available feature types: {list(_FEATURE_TYPES.keys())}")
ValueError: Feature type 'List' not found. Available feature types: ['Value', 'ClassLabel', 'Translation', 'TranslationVariableLanguages', 'LargeList', 'Sequence', 'Array2D', 'Array3D', 'Array4D', 'Array5D', 'Audio', 'Image', 'Video', 'Pdf', 'VideoFrame']
I meet this problem, does anyone could tell me how to solve it?thanks!!!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions