-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Summary
The expected URL patterns have destination;origin but OSRM API format is origin;destination.
Example: Task 737
Intent: "View the route from Carnegie Mellon University to Philadelphia 76ers stadium"
| Coordinates | Order | |
|---|---|---|
| Expected | -75.17...;-79.94... |
Philly→Pittsburgh ❌ |
| Agent | -79.94...;-75.17... |
Pittsburgh→Philly ✅ |
Fix
Swap coordinates in assets/dataset/webarena-verified.json for tasks 737, 739, 740, 741.
Example fix for task 737:
- "expected": {"url": "^.*/route/v1/.*/-75.1718916,39.9011873;-79.9427192,40.4441897.*$"}
+ "expected": {"url": "^.*/route/v1/.*/-79.9427192,40.4441897;-75.1718916,39.9011873.*$"}This issue affects tasks 259, 265, 737, 738, 739, 740, 741 in the hard task subset.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working