Hello, and thank you for the great work on this project.
I am currently running the evaluation script with the WebVoyager_data.jsonl tasks. I've encountered an issue where the script frequently fails because the initial webpage presents a "Verify you are a human" challenge. The agent is unable to bypass this verification, which causes the evaluation process to crash.
Is there a recommended solution or a known workaround for handling these CAPTCHA tests during evaluation?
Thanks for your help!
Hello, and thank you for the great work on this project.
I am currently running the evaluation script with the WebVoyager_data.jsonl tasks. I've encountered an issue where the script frequently fails because the initial webpage presents a "Verify you are a human" challenge. The agent is unable to bypass this verification, which causes the evaluation process to crash.
Is there a recommended solution or a known workaround for handling these CAPTCHA tests during evaluation?
Thanks for your help!