Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Product Map shows tests passing for a new product that has never had a test run #30

Open
ngm opened this issue Dec 31, 2017 · 4 comments

Comments

@ngm
Copy link
Owner

ngm commented Dec 31, 2017

ProductB has not yet had a test run, but it is showing as passing for the four existing features with test results:

image

@ngm
Copy link
Owner Author

ngm commented Dec 31, 2017

Same is true for the product line:

image

If we don't know the test results for one of the products, then we can't say that the features are passing for the product lne as a whole, so the green features above are wrong.

@ngm
Copy link
Owner Author

ngm commented Dec 31, 2017

The problem is that get_gherkin_piece_test_statuses
(https://github.com/ngm/aplet-cli/blob/master/aplet/pltools/ftrenderer.py#L115) returns the results for the entire product line, it doesn't have an option for individual products.

@ngm
Copy link
Owner Author

ngm commented Dec 31, 2017

Another problem is that the method is only taking pass and fail into account, not inconclusive.

@ngm
Copy link
Owner Author

ngm commented Dec 31, 2017

And another problem is that the product map is actually using the product line results for each product, not each product's own results.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant