Add aiXamine evaluator org, family, and 9 service composites - #63
Add aiXamine evaluator org, family, and 9 service composites#63fatihdeniz wants to merge 1 commit into
Conversation
|
Verified locally against current main and I recommend merging. Ran the same steps the dry-run job runs, on Result: The content reads clean to me. One evaluator org, one family, nine service composites each with a single config and a category/tags pair that matches what the service measures. Additive only, no existing entry touched. Worth landing this together with the adapter in evaleval/every_eval_ever#283, since that adapter's records resolve against these entities. |
Registers aiXamine (aixamine.qcri.org, paper) as an evaluator so its EEE records resolve to real entities.
seed/orgs.yaml—aixamineorg (tags: ["academic","evaluator"])seed/families.yaml—aixaminefamily grouping the 9 service leaderboardsseed/composites.yaml— 9aixamine-<service>composites mapping eachsource_configSeed-only (+91 lines).
seed --localingests cleanly; gate suite passes (the one failure is an unrelated models.dev drift check).