-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
"new" data sets are missing in the leader board #98
Comments
As we're getting new data ready, we will likely only automatically run 1 dataset from each scanner, to avoid overloading the STFC computing once people start to submit a lot of jobs (hopefully!). You can run them locally by adjusting your own petric. Or maybe there's a smarter option... |
makes sense. I guess in principle there could be a decision based on the hostname in otherwise the decision could be made based on a env. variable that users can set to run all data sets locally. |
could be doable I guess. @casperdcl, What do you think? 5 min job? |
let's leave it then. Participants can make this change themselves. |
Seems that the leaderboard only contains the initial 3 data sets.
If possible, they (e.g. the mMR ACR data sets) should be added here:
PETRIC/petric.py
Line 249 in 50f28f0
The text was updated successfully, but these errors were encountered: