Skip to content

Add Sqwish Router v1 submission#94

Draft
namitha-sqwish wants to merge 1 commit into
RouteWorks:mainfrom
namitha-sqwish:sqwish-router-v1-draft
Draft

Add Sqwish Router v1 submission#94
namitha-sqwish wants to merge 1 commit into
RouteWorks:mainfrom
namitha-sqwish:sqwish-router-v1-draft

Conversation

@namitha-sqwish
Copy link
Copy Markdown

@namitha-sqwish namitha-sqwish commented May 10, 2026

Add Sqwish Router v1 submission.

Includes the router config, full prediction file, and robustness prediction file.

@namitha-sqwish
Copy link
Copy Markdown
Author

/evaluate

@github-actions
Copy link
Copy Markdown

Router Evaluation Results

Router: sqwish-router-v1
Dataset Split: full

RouterArena Metrics

Metric Value
RouterArena Score 0.7258
Accuracy 72.41%
Total Cost $0.580883
Avg Cost per Query $0.000069
Avg Cost per 1K Queries $0.0692
Number of Queries 8400
Robustness Score 0.6905

Optimality Metrics

Metric Value
Opt.Sel (Optimal Selection) 0.4481
Opt.Cost (Cost Efficiency) 0.7165
Opt.Acc (Accuracy vs Optimal) 1.0000

Evaluation completed by RouterArena automated workflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant