From 2822d1ae46ec9d5ee8b9166bd6b58b23b73f0ef9 Mon Sep 17 00:00:00 2001 From: Sylvestre <sylvestre@huggingface.co> Date: Tue, 21 Jan 2025 10:08:31 +0100 Subject: [PATCH 1/3] Clarify storage management for datasets-viewer by adding information on freeing up storage through special refs --- docs/hub/storage-limits.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/hub/storage-limits.md b/docs/hub/storage-limits.md index 7bcef9c7b..5dd58104f 100644 --- a/docs/hub/storage-limits.md +++ b/docs/hub/storage-limits.md @@ -138,6 +138,8 @@ The super-squash operation compresses your entire Git history into a single comm ⚠️ **Important**: This is a destructive operation that cannot be undone, commit history will be permanently lost and **LFS file history will be removed** +For datasets with datasets-viewer enabled, you can also free up storage by squashing datasets-viewer special refs (`refs/convert/duckdb`, `refs/convert/parquet`). These refs are used by the datasets-viewer feature and can accumulate storage over time. + The effects from the squash operation on your storage quota are not immediate and will be reflected on your quota within a few minutes. ### Advanced: Track LFS file references From b366dc78a1a5220eab12827220c586cd226649e9 Mon Sep 17 00:00:00 2001 From: Sylvestre <sylvestre@huggingface.co> Date: Tue, 21 Jan 2025 10:09:31 +0100 Subject: [PATCH 2/3] Clarify storage management for datasets-viewer by adding information on freeing up storage through special refs --- docs/hub/storage-limits.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/hub/storage-limits.md b/docs/hub/storage-limits.md index 5dd58104f..2d5a0a287 100644 --- a/docs/hub/storage-limits.md +++ b/docs/hub/storage-limits.md @@ -138,7 +138,7 @@ The super-squash operation compresses your entire Git history into a single comm ⚠️ **Important**: This is a destructive operation that cannot be undone, commit history will be permanently lost and **LFS file history will be removed** -For datasets with datasets-viewer enabled, you can also free up storage by squashing datasets-viewer special refs (`refs/convert/duckdb`, `refs/convert/parquet`). These refs are used by the datasets-viewer feature and can accumulate storage over time. +For datasets with Datasets Viewer enabled, you can also free up storage by squashing Datasets Viewer special refs (`refs/convert/duckdb`, `refs/convert/parquet`). These refs are used by the Datasets Viewer and can accumulate storage over time. The effects from the squash operation on your storage quota are not immediate and will be reflected on your quota within a few minutes. From a46c458a48355e83b53055bfc7739fe1a5125d5e Mon Sep 17 00:00:00 2001 From: Sylvestre Bouchot <Kakulukian@users.noreply.github.com> Date: Tue, 21 Jan 2025 10:54:43 +0100 Subject: [PATCH 3/3] Update docs/hub/storage-limits.md Co-authored-by: Julien Chaumond <julien@huggingface.co> --- docs/hub/storage-limits.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/hub/storage-limits.md b/docs/hub/storage-limits.md index 2d5a0a287..1354e31f8 100644 --- a/docs/hub/storage-limits.md +++ b/docs/hub/storage-limits.md @@ -138,7 +138,7 @@ The super-squash operation compresses your entire Git history into a single comm ⚠️ **Important**: This is a destructive operation that cannot be undone, commit history will be permanently lost and **LFS file history will be removed** -For datasets with Datasets Viewer enabled, you can also free up storage by squashing Datasets Viewer special refs (`refs/convert/duckdb`, `refs/convert/parquet`). These refs are used by the Datasets Viewer and can accumulate storage over time. +For datasets with [Datasets Viewer enabled](https://huggingface.co/docs/hub/en/datasets-viewer-configure), you can also free up storage by squashing Datasets Viewer special refs (`refs/convert/duckdb`, `refs/convert/parquet`). These refs are used by the Datasets Viewer and can accumulate storage over time. The effects from the squash operation on your storage quota are not immediate and will be reflected on your quota within a few minutes.