Reports.cucumber.io showing 1 failed test but all green checks

[cmaustPayIt]

I looked at the GH actions that ran this test and saw that although 100% of the tests passed, one had to be rerun in order to pass. Could Reports.cucumber.io be mistaking this rerun test as a failure?

[mpkorstanje]

That would appear to be a plausible explanation. But I have no easy way to verify that.

Note: while Cucumber is back in Community Ownership we are still untangling the technical aspects. At present the reports.cucumber.io service is still ran by SmartBear.

[cmaustPayIt]

Thank you for getting back to me. After seeing today's report, I'm fairly certain reports.cucumber.io is treating reruns as failed because we had 1 script fail but the report showed 5 failed because I have Cucumber set to rerun a script 5 times.

[davidjgoss]

Yep this is correct. We'll soon be relaunching Cucumber Reports, with up-to-date functionality including handling retries properly.