We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Hi,
I had the following issue while working with WorkArena, on order-apple-watch task with seeds 826 and 66.
order-apple-watch
Task goal Go to the hardware store and order 3 "Apple Watch"
Scenario My agent completed the task as you can see in the following screenshot, but the task validation message was:
{'message': 'The page is not in the right URL to validate task OrderAppleWatchTask.'}
which doesn't end the task, so my agent is lost and tries to complete the task before achieving max steps and getting 0 reward.
Question Is this behavior expected? I believe the agent should get reward=1 and the task should stop.
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Hi,
I had the following issue while working with WorkArena, on
order-apple-watch
task with seeds 826 and 66.Task goal
Go to the hardware store and order 3 "Apple Watch"
Scenario
My agent completed the task as you can see in the following screenshot, but the task validation message was:
which doesn't end the task, so my agent is lost and tries to complete the task before achieving max steps and getting 0 reward.
Question
Is this behavior expected? I believe the agent should get reward=1 and the task should stop.
The text was updated successfully, but these errors were encountered: