You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We are setting up a competition where public and private metrics will have different names. For example, we may have different sub-splits or categories of the data reported on the leaderboards. The number and the name of these metrics will be different for public and private.
The text was updated successfully, but these errors were encountered:
ktrapeznikov
changed the title
Remove constrain for public and private scores have same keys when using custom metrics
Remove check for public and private scores to have same keys when using custom metrics
Feb 20, 2025
We are setting up a competition where public and private metrics will have different names. For example, we may have different sub-splits or categories of the data reported on the leaderboards. The number and the name of these metrics will be different for public and private.
I see this constraint is checked here:
competitions/competitions/compute_metrics.py
Line 71 in 447fff1
The text was updated successfully, but these errors were encountered: