-
-
Notifications
You must be signed in to change notification settings - Fork 195
Open
Labels
enhancementNew feature or improvement ideaNew feature or improvement idea
Description
Running evaluations in the current neuron-core/neuron-ai repository is slow because the evaluation command processes evaluators and dataset items strictly sequentially.
Details
- The
EvaluationCommandruns each evaluator one by one. - Within each evaluator, dataset items are processed in sequence via
EvaluatorRunner::run(). - For larger datasets or many evaluators, this becomes a bottleneck.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or improvement ideaNew feature or improvement idea