fix(influxdb3): document exec-mem-pool-bytes usage for data persistence #6394
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Updates documentation to reflect that exec-mem-pool-bytes is used for both query processing and parquet persistence operations, not just queries. Based on source code analysis showing the memory pool is used by: - Query executor for processing queries - Persister for converting WAL data to Parquet format Changes: - Updated config description to include "data operations" - Added memory usage info to durability docs for Parquet storage - Added troubleshooting section for memory-related write performance - Fixed capitalization of "object store" throughout Addresses DAR #499 Source analysis: influxdb3/src/commands/serve.rs:772-798 Shows separate executors for queries and write path operations, both using memory pools for data processing.
hiltontj
approved these changes
Sep 16, 2025
sanderson
approved these changes
Sep 16, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Updates documentation to reflect that
exec-mem-pool-bytesis used for both query processing and parquet persistence operations, not just queries.Based on source code analysis showing the memory pool is used by:
Changes:
Fixes https://github.com/influxdata/DAR/issues/499
Source analysis: influxdb3/src/commands/serve.rs:772-798 Shows separate executors for queries and write path operations, both using memory pools for data processing.