Skip to content

update auto router to eval#90

Merged
yl231 merged 1 commit into
RouteWorks:mainfrom
cxf2015:main
May 15, 2026
Merged

update auto router to eval#90
yl231 merged 1 commit into
RouteWorks:mainfrom
cxf2015:main

Conversation

@cxf2015
Copy link
Copy Markdown
Contributor

@cxf2015 cxf2015 commented Mar 26, 2026

/evaluate

@cxf2015
Copy link
Copy Markdown
Contributor Author

cxf2015 commented Mar 26, 2026

/evaluate

@cxf2015
Copy link
Copy Markdown
Contributor Author

cxf2015 commented Mar 26, 2026

image hi @jiarong0907 @yl231 @jqxue1999 When evaluating,there is no space left, could you handle that?

@jiarong0907
Copy link
Copy Markdown
Contributor

image hi @jiarong0907 @yl231 @jqxue1999 When evaluating,there is no space left, could you handle that?

This is more likely a github issue. Could you retry?

@cxf2015
Copy link
Copy Markdown
Contributor Author

cxf2015 commented Mar 27, 2026

/evaluate

@github-actions
Copy link
Copy Markdown

Router Evaluation Results

Router: auto_router
Dataset Split: full

RouterArena Metrics

Metric Value
RouterArena Score 0.7005
Accuracy 70.17%
Total Cost $1.045217
Avg Cost per Query $0.000124
Avg Cost per 1K Queries $0.1244
Number of Queries 8400
Robustness Score 0.4952

Optimality Metrics

Metric Value
Opt.Sel (Optimal Selection) 0.4377
Opt.Cost (Cost Efficiency) 0.4229
Opt.Acc (Accuracy vs Optimal) 1.0000

Evaluation completed by RouterArena automated workflow

@jiarong0907
Copy link
Copy Markdown
Contributor

Hi @cxf2015, just want to follow up: Do you want to have this router onto our leaderboard?

@cxf2015
Copy link
Copy Markdown
Contributor Author

cxf2015 commented May 13, 2026

ok, no problem

@jiarong0907
Copy link
Copy Markdown
Contributor

@yl231 Could you help update?

@jiarong0907 jiarong0907 requested a review from yl231 May 13, 2026 03:15
Copy link
Copy Markdown
Contributor

@yl231 yl231 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@yl231 yl231 merged commit 895e368 into RouteWorks:main May 15, 2026
6 checks passed
@yl231
Copy link
Copy Markdown
Contributor

yl231 commented May 15, 2026

Hi @cxf2015, do you want to claim affiliation of the Auto Router to any entity?

@cxf2015
Copy link
Copy Markdown
Contributor Author

cxf2015 commented May 18, 2026

Hi @cxf2015, do you want to claim affiliation of the Auto Router to any entity?

Let's have a discussion within our team first and then we'll get back to you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants