Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Task validation not trigerred for order-apple-watch task #52

Closed
imenelydiaker opened this issue Nov 29, 2024 · 0 comments
Closed

Task validation not trigerred for order-apple-watch task #52

imenelydiaker opened this issue Nov 29, 2024 · 0 comments

Comments

@imenelydiaker
Copy link

imenelydiaker commented Nov 29, 2024

Hi,

I had the following issue while working with WorkArena, on order-apple-watch task with seeds 826 and 66.

Task goal
Go to the hardware store and order 3 "Apple Watch"

Scenario
My agent completed the task as you can see in the following screenshot, but the task validation message was:

{'message': 'The page is not in the right URL to validate task OrderAppleWatchTask.'}

which doesn't end the task, so my agent is lost and tries to complete the task before achieving max steps and getting 0 reward.

image

image

Question
Is this behavior expected? I believe the agent should get reward=1 and the task should stop.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants