Skip to content

article on group assignment #19426

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

vporyadke
Copy link
Collaborator

Changelog entry

...

Changelog category

  • Documentation (changelog entry is not required)

Description for reviewers

...

@github-actions github-actions bot added the documentation Improvements or additions to documentation label Jun 6, 2025
Copy link

github-actions bot commented Jun 6, 2025

🟢 2025-06-06 10:54:51 UTC The validation of the Pull Request description is successful.

Copy link

github-actions bot commented Jun 6, 2025

2025-06-06 10:54:59 UTC Pre-commit check linux-x86_64-relwithdebinfo for e6023d7 has started.
2025-06-06 10:55:14 UTC Artifacts will be uploaded here
2025-06-06 10:57:33 UTC ya make is running...
🟢 2025-06-06 10:57:38 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-06 10:57:44 UTC Build successful.

Copy link

github-actions bot commented Jun 6, 2025

2025-06-06 10:56:50 UTC Pre-commit check linux-x86_64-release-asan for e6023d7 has started.
2025-06-06 10:57:01 UTC Artifacts will be uploaded here
2025-06-06 10:59:27 UTC ya make is running...
🟢 2025-06-06 10:59:32 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-06 10:59:38 UTC Build successful.

Copy link

github-actions bot commented Jun 6, 2025

❌ Documentation build

Revision build failed

Build logs

Errors (1)

❌ Link is unreachable: ru/concpets/glossary.md in ru/contributor/hive-storage.md.

@ydbot
Copy link
Collaborator

ydbot commented Jun 6, 2025

🔄 New commits pushed — @ElenaAfina please take a look.

Copy link

github-actions bot commented Jun 6, 2025

2025-06-06 11:38:52 UTC Pre-commit check linux-x86_64-relwithdebinfo for 5dd1296 has started.
2025-06-06 11:39:05 UTC Artifacts will be uploaded here
2025-06-06 11:41:31 UTC ya make is running...
🟢 2025-06-06 11:41:37 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-06 11:41:42 UTC Build successful.

Copy link

github-actions bot commented Jun 6, 2025

2025-06-06 11:39:24 UTC Pre-commit check linux-x86_64-release-asan for 5dd1296 has started.
2025-06-06 11:39:35 UTC Artifacts will be uploaded here
2025-06-06 11:41:57 UTC ya make is running...
🟢 2025-06-06 11:42:03 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-06 11:42:08 UTC Build successful.

Copy link

github-actions bot commented Jun 6, 2025

✅ Documentation build

Revision built successfully
Revision preview link

@vporyadke vporyadke marked this pull request as ready for review June 6, 2025 13:14
@vporyadke vporyadke requested a review from a team as a code owner June 6, 2025 13:14
@vporyadke vporyadke requested review from CyberROFL and ElenaAfina June 9, 2025 08:54
@ydbot
Copy link
Collaborator

ydbot commented Jun 9, 2025

Hey @ElenaAfina, it has been 26 business-hours since the author's last update, could you please review?

Co-authored-by: Ilnaz Nizametdinov <[email protected]>
@ydbot
Copy link
Collaborator

ydbot commented Jun 9, 2025

🔄 New commits pushed — @ElenaAfina please take a look.

Copy link

github-actions bot commented Jun 9, 2025

2025-06-09 15:14:12 UTC Pre-commit check linux-x86_64-release-asan for 0b9ed13 has started.
2025-06-09 15:14:42 UTC Artifacts will be uploaded here
2025-06-09 15:18:09 UTC ya make is running...
🟢 2025-06-09 15:18:15 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-09 15:18:20 UTC Build successful.

Copy link

github-actions bot commented Jun 9, 2025

2025-06-09 15:23:20 UTC Pre-commit check linux-x86_64-relwithdebinfo for 0b9ed13 has started.
2025-06-09 15:23:31 UTC Artifacts will be uploaded here
2025-06-09 15:25:49 UTC ya make is running...
🟢 2025-06-09 15:25:55 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-09 15:26:00 UTC Build successful.

Copy link

github-actions bot commented Jun 9, 2025

✅ Documentation build

Revision built successfully
Revision preview link

Copy link

github-actions bot commented Jun 10, 2025

2025-06-10 09:30:34 UTC Pre-commit check linux-x86_64-relwithdebinfo for 5ad8daf has started.
2025-06-10 09:30:56 UTC Artifacts will be uploaded here
2025-06-10 09:33:53 UTC ya make is running...
🟢 2025-06-10 09:33:59 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-10 09:34:05 UTC Build successful.

@ydbot
Copy link
Collaborator

ydbot commented Jun 10, 2025

🔄 New commits pushed — @ElenaAfina please take a look.

Copy link

github-actions bot commented Jun 10, 2025

2025-06-10 09:32:39 UTC Pre-commit check linux-x86_64-release-asan for 5ad8daf has started.
2025-06-10 09:33:05 UTC Artifacts will be uploaded here
2025-06-10 09:35:56 UTC ya make is running...
🟢 2025-06-10 09:36:01 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-10 09:36:08 UTC Build successful.

Copy link

❌ Documentation build

Revision build failed

Build logs

Errors (1)

❌ Link is unreachable: ru/concpets/glossary.md in ru/contributor/hive-storage.md.

Copy link

github-actions bot commented Jun 11, 2025

2025-06-11 12:22:30 UTC Pre-commit check linux-x86_64-relwithdebinfo for 4ba19cd has started.
2025-06-11 12:22:42 UTC Artifacts will be uploaded here
2025-06-11 12:25:10 UTC ya make is running...
🟢 2025-06-11 12:25:16 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-11 12:25:22 UTC Build successful.

@ydbot
Copy link
Collaborator

ydbot commented Jun 11, 2025

🔄 New commits pushed — @ElenaAfina please take a look.

Copy link

github-actions bot commented Jun 11, 2025

2025-06-11 12:28:34 UTC Pre-commit check linux-x86_64-relwithdebinfo for 86c4149 has started.
2025-06-11 12:28:45 UTC Artifacts will be uploaded here
2025-06-11 12:31:14 UTC ya make is running...
🟢 2025-06-11 12:31:19 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-11 12:31:26 UTC Build successful.

Copy link

github-actions bot commented Jun 11, 2025

2025-06-11 12:29:54 UTC Pre-commit check linux-x86_64-release-asan for 86c4149 has started.
2025-06-11 12:30:05 UTC Artifacts will be uploaded here
2025-06-11 12:32:32 UTC ya make is running...
🟢 2025-06-11 12:32:37 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-11 12:32:43 UTC Build successful.

Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@vporyadke vporyadke requested a review from CyberROFL June 11, 2025 12:46
@ydbot
Copy link
Collaborator

ydbot commented Jun 12, 2025

Hey @ElenaAfina, it has been 104 business-hours since the author's last update, could you please review?

@CyberROFL
Copy link
Member

@ydbot
Copy link
Collaborator

ydbot commented Jun 17, 2025

Hey @ElenaAfina, it has been 164 business-hours since the author's last update, could you please review?

@ydbot
Copy link
Collaborator

ydbot commented Jun 17, 2025

🔄 New commits pushed — @ElenaAfina please take a look.

Copy link

github-actions bot commented Jun 17, 2025

2025-06-17 15:07:55 UTC Pre-commit check linux-x86_64-relwithdebinfo for 6509191 has started.
2025-06-17 15:08:52 UTC Artifacts will be uploaded here
2025-06-17 15:11:34 UTC ya make is running...
🟢 2025-06-17 15:11:40 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-17 15:11:47 UTC Build successful.

Copy link

github-actions bot commented Jun 17, 2025

2025-06-17 15:15:31 UTC Pre-commit check linux-x86_64-release-asan for 6509191 has started.
2025-06-17 15:15:43 UTC Artifacts will be uploaded here
2025-06-17 15:18:14 UTC ya make is running...
🟢 2025-06-17 15:18:21 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-17 15:18:27 UTC Build successful.

Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@ydbot
Copy link
Collaborator

ydbot commented Jun 17, 2025

🔄 New commits pushed — @ElenaAfina please take a look.

Copy link

github-actions bot commented Jun 17, 2025

2025-06-17 15:31:19 UTC Pre-commit check linux-x86_64-release-asan for 2460a1b has started.
2025-06-17 15:31:32 UTC Artifacts will be uploaded here
2025-06-17 15:34:00 UTC ya make is running...
🟢 2025-06-17 15:34:06 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-17 15:34:12 UTC Build successful.

Copy link

github-actions bot commented Jun 17, 2025

2025-06-17 15:34:03 UTC Pre-commit check linux-x86_64-relwithdebinfo for 2460a1b has started.
2025-06-17 15:34:15 UTC Artifacts will be uploaded here
2025-06-17 15:36:40 UTC ya make is running...
🟢 2025-06-17 15:36:46 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-17 15:36:52 UTC Build successful.

Copy link

✅ Documentation build

Revision built successfully
Revision preview link


## Единицы аллокации {#allocation-units}

Как и для [выбора узла](hive-booting.md#findbestnode) для запуска таблеток, для выбора групп в Hive предусмотрен учёт потребления таблетками ресурсов. Однако, смена группы — более редкая операция, поэтому вместо мгновенных значений потребления используется механизм [единиц аллокации](../concepts/glossary.md#allocation-unit): при создании таблетки [SchemeShard](../concepts/glossary.md#scheme-shard) выставляет для каждого из каналов ожидаемое потребление ресурсов этим каналом, и Hive в дальнейшем использует эти значения. Единицами аллокации для различных таблеток можно управлять при помощи секции `channel_profile_config` в конфигурации кластера. Используются метрики:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

поэтому вместо мгновенных значений потребления используется механизм единиц аллокации

Еще раз перечитал — получается хрень. И я не понял, как связаны единицы аллокации, ожидаемое потребление и мгновенное значение потребления. А читатели и подавно не поймут.

@ydbot
Copy link
Collaborator

ydbot commented Jun 18, 2025

Hey @ElenaAfina, it has been 200 business-hours since the author's last update, could you please review?

@ydbot
Copy link
Collaborator

ydbot commented Jun 19, 2025

🔄 New commits pushed — @ElenaAfina please take a look.

Copy link

github-actions bot commented Jun 19, 2025

2025-06-19 08:47:45 UTC Pre-commit check linux-x86_64-release-asan for fddffba has started.
2025-06-19 08:47:50 UTC Artifacts will be uploaded here
2025-06-19 08:50:19 UTC ya make is running...
🟢 2025-06-19 08:50:25 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-19 08:50:32 UTC Build successful.

Copy link

github-actions bot commented Jun 19, 2025

2025-06-19 08:47:46 UTC Pre-commit check linux-x86_64-relwithdebinfo for fddffba has started.
2025-06-19 08:47:50 UTC Artifacts will be uploaded here
2025-06-19 08:50:23 UTC ya make is running...
🟢 2025-06-19 08:50:29 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-06-19 08:50:36 UTC Build successful.

@@ -30,7 +30,7 @@ $$

## Единицы аллокации {#allocation-units}

Как и для [выбора узла](hive-booting.md#findbestnode) для запуска таблеток, для выбора групп в Hive предусмотрен учёт потребления таблетками ресурсов. Однако, смена группы — более редкая операция, поэтому вместо мгновенных значений потребления используется механизм [единиц аллокации](../concepts/glossary.md#allocation-unit): при создании таблетки [SchemeShard](../concepts/glossary.md#scheme-shard) выставляет для каждого из каналов ожидаемое потребление ресурсов этим каналом, и Hive в дальнейшем использует эти значения. Единицами аллокации для различных таблеток можно управлять при помощи секции `channel_profile_config` в конфигурации кластера. Используются метрики:
Как и для [выбора узла](hive-booting.md#findbestnode) для запуска таблеток, для выбора групп в Hive предусмотрен учёт потребления таблетками ресурсов. Однако, смена группы — более редкая операция, поэтому мгновенные значения потребления для неё бы не подошли. Вместо этого используются фиксированные при создании таблетки значения: [SchemeShard](../concepts/glossary.md#scheme-shard) выставляет для каждого из каналов [единицу аллокации](../concepts/glossary.md#allocation-unit) — ожидаемое потребление ресурсов этим каналом, и Hive в дальнейшем использует эти значения. Единицами аллокации для различных таблеток можно управлять при помощи секции `channel_profile_config` в конфигурации кластера. Используются метрики:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Всё равно не понимаю, почему мгновенные значения не подходят для редких операций балансировки групп. Тут, наверно, надо писать, что мгновенные значения могут давать выбросы (почему мы их не сглаживаем?) и поэтому используется фиксированное ожидаемое потребление. Но тогда это уже не учет потребления ресурсов.

@ydbot
Copy link
Collaborator

ydbot commented Jun 20, 2025

Hey @ElenaAfina, it has been 242 business-hours since the author's last update, could you please review?

@ydbot
Copy link
Collaborator

ydbot commented Jun 23, 2025

Hey @ElenaAfina, it has been 272 business-hours since the author's last update, could you please review?

@ydbot
Copy link
Collaborator

ydbot commented Jun 25, 2025

Hey @ElenaAfina, it has been 302 business-hours since the author's last update, could you please review?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants