feat: Add Hugging Face Datasets plugin#629

Closed

andreahlert wants to merge 16 commits into

flyteorg:mainfrom

andreahlert:feat/huggingface-plugin

Commits on Mar 31, 2026

feat: Add Hugging Face Datasets plugin
andreahlert
committed
fix: use public logger import instead of private _logging module
andreahlert
committed
chore(plugins/huggingface): merge main, use public storage API, align infra
andreahlert
committed
style(huggingface): remove unused MagicMock import
andreahlert
committed
refactor(plugins/huggingface): use public flyte.io import for PARQUET, DataFrame
andreahlert
committed
refactor(plugins/huggingface): make storage options helper private
andreahlert
committed
refactor(plugins/huggingface): use pyarrow directly for decode
andreahlert
committed
refactor(plugins/huggingface): symmetric encode/decode via pyarrow filesystem
andreahlert
committed
style(plugins/huggingface): remove trailing blank lines in test file
andreahlert
committed
Remove --pre flag from install instructions
andreahlert
committed
Add usage examples to README
andreahlert
committed
Use public flyte.extend.lazy_module instead of private _utils import
andreahlert
committed