The api and rows services cannot store datasets cache

[severo]

The datasets cache, for api and rows services (they depend on datasets), is not set, and by default is /.cache/huggingface/datasets. But this directory is not accessible by the python user.

I'm not sure if it's an issue, but I think we should:

• set the datasets environment variable for these services (note that all the pods that depend on libcommon potentially have the same issue, but not all of them use datasets)
• or better (but it's more work) create a libs/libdatasets library, that should only be used by /rows and the workers

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.