Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support of different ydb flavours in tests #16213

Merged
merged 2 commits into from
Mar 25, 2025

Conversation

maximyurchuk
Copy link
Collaborator

@maximyurchuk maximyurchuk commented Mar 25, 2025

Фикстура, которая позволяет параметризовывать тесты с разными версиями ydb (в том числе внутренними)
+ пример использования
#16120

Copy link

github-actions bot commented Mar 25, 2025

🟢 2025-04-02 14:56:48 UTC The validation of the Pull Request description is successful.

Copy link

github-actions bot commented Mar 25, 2025

2025-03-25 13:23:35 UTC Pre-commit check linux-x86_64-relwithdebinfo for 8d8124f has started.
2025-03-25 13:23:50 UTC Artifacts will be uploaded here
2025-03-25 13:26:08 UTC ya make is running...
🟡 2025-03-25 13:34:21 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
142 133 0 1 2 6

2025-03-25 13:34:33 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-25 13:37:09 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14 (only retried tests) 7 0 1 0 6

2025-03-25 13:37:21 UTC ya make is running... (failed tests rerun, try 3)
🔴 2025-03-25 13:39:49 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14 (only retried tests) 7 0 1 0 6

🟢 2025-03-25 13:39:56 UTC Build successful.
🟢 2025-03-25 13:40:06 UTC ydbd size 2.2 GiB changed* by +37.4 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 575de06 merge: 8d8124f diff diff %
ydbd size 2 321 261 848 Bytes 2 321 300 104 Bytes +37.4 KiB +0.002%
ydbd stripped size 485 298 496 Bytes 485 307 456 Bytes +8.8 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 25, 2025

2025-03-25 13:25:54 UTC Pre-commit check linux-x86_64-release-asan for 8d8124f has started.
2025-03-25 13:26:08 UTC Artifacts will be uploaded here
2025-03-25 13:28:20 UTC ya make is running...
🟡 2025-03-25 13:30:22 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15 14 0 1 0 0

2025-03-25 13:30:33 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-25 13:33:13 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
2 (only retried tests) 1 0 1 0 0

2025-03-25 13:33:22 UTC ya make is running... (failed tests rerun, try 3)
🟡 2025-03-25 13:34:33 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
2 (only retried tests) 1 0 1 0 0

🟢 2025-03-25 13:34:39 UTC Build successful.
🟢 2025-03-25 13:34:51 UTC ydbd size 3.8 GiB changed* by +50.9 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 575de06 merge: 8d8124f diff diff %
ydbd size 4 083 531 984 Bytes 4 083 584 136 Bytes +50.9 KiB +0.001%
ydbd stripped size 1 410 960 872 Bytes 1 410 980 488 Bytes +19.2 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 25, 2025

2025-03-25 14:02:17 UTC Pre-commit check linux-x86_64-relwithdebinfo for e712403 has started.
2025-03-25 14:02:34 UTC Artifacts will be uploaded here
2025-03-25 14:04:56 UTC ya make is running...
🟢 2025-03-25 14:14:54 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
142 134 0 0 2 6

🟢 2025-03-25 14:15:03 UTC Build successful.
🟢 2025-03-25 14:15:13 UTC ydbd size 2.2 GiB changed* by +37.4 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 575de06 merge: e712403 diff diff %
ydbd size 2 321 261 848 Bytes 2 321 300 104 Bytes +37.4 KiB +0.002%
ydbd stripped size 485 298 496 Bytes 485 307 456 Bytes +8.8 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 25, 2025

2025-03-25 14:02:43 UTC Pre-commit check linux-x86_64-release-asan for e712403 has started.
2025-03-25 14:02:58 UTC Artifacts will be uploaded here
2025-03-25 14:05:17 UTC ya make is running...
🟢 2025-03-25 14:07:00 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15 15 0 0 0 0

🟢 2025-03-25 14:07:09 UTC Build successful.
🟢 2025-03-25 14:07:23 UTC ydbd size 3.8 GiB changed* by +50.9 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 575de06 merge: e712403 diff diff %
ydbd size 4 083 531 984 Bytes 4 083 584 136 Bytes +50.9 KiB +0.001%
ydbd stripped size 1 410 960 872 Bytes 1 410 980 488 Bytes +19.2 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@maximyurchuk maximyurchuk marked this pull request as ready for review March 25, 2025 15:27
@maximyurchuk maximyurchuk merged commit 3200400 into ydb-platform:main Mar 25, 2025
16 checks passed
@maximyurchuk maximyurchuk requested a review from Copilot March 27, 2025 15:34
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds support for running tests against different ydb flavours by introducing a new fixture and updating test configurations accordingly.

  • Introduces a fixture that extracts binary paths for different ydb flavours from environment variables.
  • Updates the test configurator and pytest plugins to use the new fixture.
  • Provides an example of how to parameterize tests with multiple ydb flavours.

Reviewed Changes

Copilot reviewed 3 out of 7 changed files in this pull request and generated no comments.

File Description
ydb/tests/library/flavours/init.py Adds the flavour fixture to extract and map environment variables to binary paths.
ydb/tests/functional/tenants/test_users_groups_with_acl.py Updates the configurator fixture to accept a binary path based on the new flavour fixture.
ydb/tests/functional/tenants/conftest.py Includes the new flavour plugin in the pytest configuration.
Files not reviewed (4)
  • ydb/tests/functional/tenants/ya.make: Language not supported
  • ydb/tests/library/flavours/flavours_deps.inc: Language not supported
  • ydb/tests/library/flavours/ya.make: Language not supported
  • ydb/tests/library/ya.make: Language not supported
Comments suppressed due to low confidence (2)

ydb/tests/library/flavours/init.py:16

  • [nitpick] Consider enhancing this error message to include the expected environment variable prefix or list any discovered keys (if any) to aid debugging when the fixture is misconfigured.
raise RuntimeError("Flavours not found. Did you forget to include 'tests/library/flavours/flavours_deps.inc' in ya.make?")

ydb/tests/functional/tenants/test_users_groups_with_acl.py:22

  • Ensure that tests are updated or added to cover scenarios with multiple ydb flavours, and include documentation for the new 'ydb_flavour_path' parameter in the fixture.
def ydb_configurator(ydb_cluster_configuration, domain_login_only, ydb_flavour_path):

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants