Skip to content

[wptrunner] Coerce script timeout to integer for non-wdspec tests#58026

Open
jonathan-j-lee wants to merge 1 commit intoweb-platform-tests:masterfrom
jonathan-j-lee:wptrunner/timeout-int
Open

[wptrunner] Coerce script timeout to integer for non-wdspec tests#58026
jonathan-j-lee wants to merge 1 commit intoweb-platform-tests:masterfrom
jonathan-j-lee:wptrunner/timeout-int

Conversation

@jonathan-j-lee
Copy link
Contributor

@jonathan-j-lee jonathan-j-lee commented Feb 25, 2026

https://crrev.com/c/7522226 seems to have caused Chrome on iOS results to disappear from wpt.fyi because the final timeout is fractional:

webdriver.error.InvalidArgumentException: invalid argument (500): Timeouts must be non-negative integers

This can be replicated with the right wpt run --timeout-multiplier, so avoid fractional timeouts in general. The spec for "Set Timeouts" isn't clear on how they should be handled (w3c/webdriver#1949), but the de facto behavior is to return "invalid argument".

Note that the WebDriver client can still send fractional timeouts to test invalid values.

https://crrev.com/c/7522226 seems to have caused Chrome on iOS results
to disappear from wpt.fyi because the final timeout is [fractional]:

```
webdriver.error.InvalidArgumentException: invalid argument (500): Timeouts must be non-negative integers
```

This can be replicated with the right `wpt run --timeout-multiplier`, so
avoid fractional timeouts in general. The spec for "Set Timeouts" isn't
clear on how they should be handled (w3c/webdriver#1949), but the de
facto behavior is to return "invalid argument".

Note that the WebDriver client can still send fractional timeouts to
test invalid values.

[fractional]: https://chromium-swarm.appspot.com/task?id=7673a57e106bad10&w=true
@jonathan-j-lee jonathan-j-lee marked this pull request as ready for review February 25, 2026 04:58
@wpt-pr-bot wpt-pr-bot added infra wptrunner The automated test runner, commonly called through ./wpt run labels Feb 25, 2026
@jonathan-j-lee jonathan-j-lee enabled auto-merge (squash) February 25, 2026 04:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

infra wptrunner The automated test runner, commonly called through ./wpt run

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants