Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added parameters for YQL CREATE TRANSFER #15770

Merged
merged 24 commits into from
Mar 20, 2025

Conversation

nshestakov
Copy link
Collaborator

@nshestakov nshestakov commented Mar 14, 2025

Changelog entry

...

Changelog category

  • Not for changelog (changelog entry is not required)

Description for reviewers

Тут меняю proto без обратной совместимости, но эта функциональность еще никуда не выехала, и нигде не используется, только в тестах. Т.е. никому ничего не сломаю.

Основная идея замены repeated Targets на optional Target - это то, что всегда будет по одному таргету в трансфере. Заложенной возможности сделать несколько уже не получится т.к. таким транфером будет сложно управлять через YQL.

@nshestakov nshestakov requested review from a team as code owners March 14, 2025 15:54
@nshestakov nshestakov requested a review from CyberROFL March 14, 2025 15:54
Copy link

github-actions bot commented Mar 14, 2025

🟢 2025-03-17 13:37:24 UTC The validation of the Pull Request description is successful.

Copy link

github-actions bot commented Mar 14, 2025

2025-03-14 15:55:42 UTC Pre-commit check linux-x86_64-relwithdebinfo for d70cee2 has started.
2025-03-14 15:55:56 UTC Artifacts will be uploaded here
2025-03-14 15:59:05 UTC ya make is running...
🔴 2025-03-14 16:34:50 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Mar 14, 2025

2025-03-14 15:55:43 UTC Pre-commit check linux-x86_64-release-asan for d70cee2 has started.
2025-03-14 15:55:58 UTC Artifacts will be uploaded here
2025-03-14 15:59:07 UTC ya make is running...
🔴 2025-03-14 16:41:15 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 08:08:46 UTC Pre-commit check linux-x86_64-release-asan for 84abb23 has started.
2025-03-17 08:08:51 UTC Artifacts will be uploaded here
2025-03-17 08:12:14 UTC ya make is running...
🔴 2025-03-17 08:48:43 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 08:09:56 UTC Pre-commit check linux-x86_64-relwithdebinfo for 84abb23 has started.
2025-03-17 08:10:12 UTC Artifacts will be uploaded here
2025-03-17 08:13:21 UTC ya make is running...
🔴 2025-03-17 08:47:10 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 10:11:29 UTC Pre-commit check linux-x86_64-relwithdebinfo for e92d8dd has started.
2025-03-17 10:12:00 UTC Artifacts will be uploaded here
2025-03-17 10:15:48 UTC ya make is running...
🔴 2025-03-17 10:45:08 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 10:12:17 UTC Pre-commit check linux-x86_64-release-asan for e92d8dd has started.
2025-03-17 10:12:32 UTC Artifacts will be uploaded here
2025-03-17 10:15:50 UTC ya make is running...
🔴 2025-03-17 10:49:01 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 10:55:50 UTC Pre-commit check linux-x86_64-release-asan for 3c271c5 has started.
2025-03-17 10:56:05 UTC Artifacts will be uploaded here
2025-03-17 10:59:24 UTC ya make is running...
2025-03-17 11:03:28 UTC Check cancelled

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 10:58:41 UTC Pre-commit check linux-x86_64-relwithdebinfo for 3c271c5 has started.
2025-03-17 10:58:57 UTC Artifacts will be uploaded here
2025-03-17 11:02:12 UTC ya make is running...
2025-03-17 11:03:25 UTC Check cancelled

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 11:05:02 UTC Pre-commit check linux-x86_64-release-asan for 20c97eb has started.
2025-03-17 11:05:17 UTC Artifacts will be uploaded here
2025-03-17 11:08:23 UTC ya make is running...
🟡 2025-03-17 12:46:22 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14098 14012 0 31 16 39

2025-03-17 12:48:19 UTC ya make is running... (failed tests rerun, try 2)

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 11:06:24 UTC Pre-commit check linux-x86_64-relwithdebinfo for 20c97eb has started.
2025-03-17 11:06:30 UTC Artifacts will be uploaded here
2025-03-17 11:09:34 UTC ya make is running...
🟡 2025-03-17 12:39:27 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
28559 25941 0 12 2487 119

2025-03-17 12:41:49 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-17 12:55:15 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
189 (only retried tests) 66 0 8 3 112

2025-03-17 12:55:25 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-03-17 13:06:39 UTC ydbd size 2.1 GiB changed* by +78.7 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: b071759 merge: 20c97eb diff diff %
ydbd size 2 298 240 136 Bytes 2 298 320 696 Bytes +78.7 KiB +0.004%
ydbd stripped size 481 101 216 Bytes 481 115 968 Bytes +14.4 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
2025-03-17 13:06:41 UTC Check cancelled

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 13:12:45 UTC Pre-commit check linux-x86_64-relwithdebinfo for 0eb39e1 has started.
2025-03-17 13:13:01 UTC Artifacts will be uploaded here
2025-03-17 13:16:22 UTC ya make is running...
2025-03-17 13:18:23 UTC Check cancelled

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 13:13:33 UTC Pre-commit check linux-x86_64-release-asan for 0eb39e1 has started.
2025-03-17 13:13:46 UTC Artifacts will be uploaded here
2025-03-17 13:16:55 UTC ya make is running...
2025-03-17 13:18:21 UTC Check cancelled

Copy link

github-actions bot commented Mar 19, 2025

2025-03-19 11:31:47 UTC Pre-commit check linux-x86_64-relwithdebinfo for fb0a51b has started.
2025-03-19 11:32:03 UTC Artifacts will be uploaded here
2025-03-19 11:35:22 UTC ya make is running...
🟡 2025-03-19 13:11:00 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
28621 25981 0 8 2513 119

2025-03-19 13:13:28 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-19 13:31:38 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
196 (only retried tests) 68 0 6 9 113

2025-03-19 13:31:49 UTC ya make is running... (failed tests rerun, try 3)
🔴 2025-03-19 13:51:13 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
168 (only retried tests) 43 0 6 7 112

🟢 2025-03-19 13:51:21 UTC Build successful.
🟢 2025-03-19 13:51:43 UTC ydbd size 2.1 GiB changed* by +93.1 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 749b883 merge: fb0a51b diff diff %
ydbd size 2 300 546 664 Bytes 2 300 642 032 Bytes +93.1 KiB +0.004%
ydbd stripped size 481 508 480 Bytes 481 529 312 Bytes +20.3 KiB +0.004%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 19, 2025

2025-03-19 11:44:10 UTC Pre-commit check linux-x86_64-release-asan for fb0a51b has started.
2025-03-19 11:44:26 UTC Artifacts will be uploaded here
2025-03-19 11:47:43 UTC ya make is running...
🟡 2025-03-19 13:34:00 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14144 14028 0 50 29 37

2025-03-19 13:35:12 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-19 13:51:15 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
169 (only retried tests) 115 0 6 15 33

2025-03-19 13:51:23 UTC ya make is running... (failed tests rerun, try 3)
🟡 2025-03-19 14:04:46 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
81 (only retried tests) 31 0 5 10 35

🟢 2025-03-19 14:04:56 UTC Build successful.
🟡 2025-03-19 14:05:27 UTC ydbd size 3.8 GiB changed* by +228.2 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 749b883 merge: fb0a51b diff diff %
ydbd size 4 050 721 664 Bytes 4 050 955 304 Bytes +228.2 KiB +0.006%
ydbd stripped size 1 401 312 328 Bytes 1 401 391 624 Bytes +77.4 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 19, 2025

2025-03-19 14:35:39 UTC Pre-commit check linux-x86_64-relwithdebinfo for 401df7c has started.
2025-03-19 14:36:03 UTC Artifacts will be uploaded here
2025-03-19 14:39:55 UTC ya make is running...
🟡 2025-03-19 15:53:40 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
28627 26011 0 2 2494 120

2025-03-19 15:56:18 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-03-19 16:19:19 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
177 (only retried tests) 62 0 0 3 112

🟢 2025-03-19 16:19:28 UTC Build successful.
🟢 2025-03-19 16:19:48 UTC ydbd size 2.1 GiB changed* by +93.2 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: a95cd74 merge: 401df7c diff diff %
ydbd size 2 301 025 808 Bytes 2 301 121 256 Bytes +93.2 KiB +0.004%
ydbd stripped size 481 570 624 Bytes 481 591 520 Bytes +20.4 KiB +0.004%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 19, 2025

2025-03-19 14:36:18 UTC Pre-commit check linux-x86_64-release-asan for 401df7c has started.
2025-03-19 14:36:34 UTC Artifacts will be uploaded here
2025-03-19 14:39:53 UTC ya make is running...
🟡 2025-03-19 16:04:32 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14149 14028 0 59 23 39

2025-03-19 16:05:50 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-19 16:31:31 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
175 (only retried tests) 132 0 1 7 35

2025-03-19 16:31:43 UTC ya make is running... (failed tests rerun, try 3)
🟡 2025-03-19 16:43:44 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
73 (only retried tests) 33 0 1 4 35

🟢 2025-03-19 16:43:53 UTC Build successful.
🟡 2025-03-19 16:44:26 UTC ydbd size 3.8 GiB changed* by +228.3 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: a95cd74 merge: 401df7c diff diff %
ydbd size 4 051 465 544 Bytes 4 051 699 288 Bytes +228.3 KiB +0.006%
ydbd stripped size 1 401 500 872 Bytes 1 401 580 232 Bytes +77.5 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 20, 2025

2025-03-20 05:59:52 UTC Pre-commit check linux-x86_64-relwithdebinfo for 8d64620 has started.
2025-03-20 06:00:06 UTC Artifacts will be uploaded here
2025-03-20 06:03:18 UTC ya make is running...
🟡 2025-03-20 07:34:25 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
28576 25962 0 1 2494 119

2025-03-20 07:36:56 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-03-20 07:57:49 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
173 (only retried tests) 61 0 0 2 110

🟢 2025-03-20 07:57:59 UTC Build successful.
🟢 2025-03-20 07:58:18 UTC ydbd size 2.1 GiB changed* by +94.1 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: eaed37b merge: 8d64620 diff diff %
ydbd size 2 301 843 040 Bytes 2 301 939 424 Bytes +94.1 KiB +0.004%
ydbd stripped size 481 671 552 Bytes 481 695 904 Bytes +23.8 KiB +0.005%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@nshestakov nshestakov requested review from CyberROFL and uniquelogin and removed request for a team March 20, 2025 06:01
Copy link

github-actions bot commented Mar 20, 2025

2025-03-20 06:04:32 UTC Pre-commit check linux-x86_64-release-asan for 8d64620 has started.
2025-03-20 06:04:49 UTC Artifacts will be uploaded here
2025-03-20 06:08:05 UTC ya make is running...
🟡 2025-03-20 07:55:28 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14103 13979 0 69 20 35

2025-03-20 07:56:40 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-20 08:09:02 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
170 (only retried tests) 131 0 1 5 33

2025-03-20 08:09:10 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-03-20 08:29:24 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
64 (only retried tests) 28 0 0 5 31

🟢 2025-03-20 08:29:33 UTC Build successful.
🟡 2025-03-20 08:30:04 UTC ydbd size 3.8 GiB changed* by +222.7 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: eaed37b merge: 8d64620 diff diff %
ydbd size 4 052 784 176 Bytes 4 053 012 184 Bytes +222.7 KiB +0.006%
ydbd stripped size 1 401 808 136 Bytes 1 401 885 704 Bytes +75.8 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

adameat pushed a commit to adameat/ydb that referenced this pull request Mar 20, 2025
…ze, consumer_name

<ydb-platform#15770>
commit_hash:f9e7a01a29938b4bec4aacdaa4e116101326f7da
nshestakov added a commit to nshestakov/ydb-embedded-ui that referenced this pull request Mar 20, 2025
@nshestakov nshestakov enabled auto-merge (squash) March 20, 2025 15:21
const auto result = session.ExecuteSchemeQuery(query).GetValueSync();
UNIT_ASSERT_VALUES_EQUAL_C(result.GetStatus(), EStatus::GENERIC_ERROR, result.GetIssues().ToString());
UNIT_ASSERT_STRING_CONTAINS(result.GetIssues().ToOneLineString(), "consumer must be not empty");
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

можно написать юнит тест который создаст трансфер с использованием query service? https://github.com/ydb-platform/ydb/blob/main/ydb/core/kqp/ut/scheme/kqp_scheme_ut.cpp#L6074

@nshestakov nshestakov merged commit f99e2a2 into ydb-platform:main Mar 20, 2025
12 checks passed
@nshestakov nshestakov deleted the TR-consumer branch March 20, 2025 16:32
blinkov pushed a commit that referenced this pull request Mar 21, 2025
…ze, consumer_name

<#15770>
commit_hash:f9e7a01a29938b4bec4aacdaa4e116101326f7da
Emgariko pushed a commit to Emgariko/ydb that referenced this pull request Mar 24, 2025
…ze, consumer_name

<ydb-platform#15770>
commit_hash:f9e7a01a29938b4bec4aacdaa4e116101326f7da
Emgariko pushed a commit to Emgariko/ydb that referenced this pull request Mar 24, 2025
lberserq pushed a commit to lberserq/ydb that referenced this pull request Mar 28, 2025
…ze, consumer_name

<ydb-platform#15770>
commit_hash:f9e7a01a29938b4bec4aacdaa4e116101326f7da
lberserq pushed a commit to lberserq/ydb that referenced this pull request Mar 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants