Skip to content

Commit 3ab9d2f

Browse files
Merge pull request #429 from appdevforall/feat/ADFA-5094-tree-gzip
ADFA-5094: publish the topic tree gzipped to R2 (~3 MB, not ~16 MB)
2 parents 8f8b606 + 83244bb commit 3ab9d2f

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

‎.github/workflows/publish-catalogs.yml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@ jobs:
3636
- name: Generate catalogs
3737
run: |
3838
python3 tools/build_kolibri_catalog.py || echo "::warning::kolibri generator failed; its upload will be skipped"
39-
python3 tools/build_kolibri_catalog.py --tree topics || echo "::warning::kolibri tree generator failed; its upload will be skipped"
39+
python3 tools/build_kolibri_catalog.py --tree topics && gzip -9 -n -f src/main/assets/kolibri_tree.jsonl || echo "::warning::kolibri tree generator failed; its upload will be skipped"
4040
python3 tools/build_kiwix_catalog.py || echo "::warning::kiwix generator failed; its upload will be skipped"
4141
4242
- name: Build manifests and upload to Cloudflare R2
@@ -84,5 +84,5 @@ jobs:
8484
}
8585
8686
publish kolibri src/main/assets/kolibri_catalog.jsonl "application/x-ndjson" jsonl
87-
publish kolibri-tree src/main/assets/kolibri_tree.jsonl "application/x-ndjson" none
87+
publish kolibri-tree src/main/assets/kolibri_tree.jsonl.gz "application/gzip" none
8888
publish kiwix src/main/assets/kiwix_catalog.csv "text/csv" none

0 commit comments

Comments
 (0)