Skip to content

Compute stats over all (not just nwb), and plot count and size as well in time #114

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

yarikoptic
Copy link
Member

@yarikoptic yarikoptic commented Mar 31, 2025

Temporal plot for size is suboptimally created since just orders by creation time, so later changes could potentially attributed to earlier time. But for the sake of visualization I think it is ok.

image

And if we revert back to plotting only NWB dandisets we would get
image

which is inline (ref @satra) with https://github.com/datalad/datasets.datalad.org-gitlog-stats/blob/master/plots/neurorepos-1.svg stating 335TB but includes only public dandisets and without zarrs, so here it would be dashed blue line and axis on the right.

TODOs

  • push rewrite with a clean run and full (not just NWB) stats
  • submit separate unrelated codespell fix

@yarikoptic yarikoptic force-pushed the enh-stats2 branch 2 times, most recently from 3f9d7ce to 9f1938c Compare March 31, 2025 21:20
@yarikoptic yarikoptic requested review from satra and bendichter March 31, 2025 21:52
@bendichter
Copy link
Member

Why is the orange line on the second plot short?

@yarikoptic
Copy link
Member Author

Why is the orange line on the second plot short?

I think it is due to a bug :-( in dandi-archive:

…l in time

Temporal plot for size is suboptimally created since just orders by
creation time, so later changes could potentially attributed to earlier time.
But for the sake of visualization I think it is ok.

Note: if re-doing for NWB only, ATM we have an issue that asset stats are not
computed for embargoed, see discussion/pointers in
#114 (comment)
@yarikoptic
Copy link
Member Author

I have pushed rewrite with up to date run. I would prefer to not wait for issues elsewhere to be resolved and just proceed with this as is for now . WDYT @bendichter ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants