refactor(storage): decouple table change logs from hummock versions

[wenym1]

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.

What's changed and what's your intention?

This PR decouples table change logs from persisted Hummock MVCC version metadata. Table change-log SSTs are already persisted and tracked independently, so storing them in HummockVersion and serialized HummockVersionDelta duplicated state and incorrectly pulled them into version-based GC accounting.

• Remove table change logs from the runtime Hummock version, frontend projections, time-travel versions, and local pinned versions.
• Keep change-log deltas alongside each Hummock version delta in meta's transient SingleDeltaTransaction, while omitting them from Hummock version serialization.
• Persist table change-log updates transactionally through meta's independent table change-log state.
• Stop including table change-log SSTs in Hummock version GC object collection.
• Keep protobuf fields 6 and 10 as deprecated compatibility fields. Persisted legacy values are warned about and ignored, while newly serialized versions and deltas leave the fields empty.
• Remove the completed startup migration and legacy delta replay path.
• Make backward-compatibility tests upgrade through the latest stable patch of each intermediate release line. Intermediate clusters run only the synchronous RECOVER command before stopping; the full validation suite runs only on the final version. This preserves one-time migrations when testing skipped release lines, for example v2.8.5 → v3.0.2 → v3.1.0.

Testing

• cargo test -p risingwave_hummock_sdk deprecated_change_log_delta_is_ignored
• cargo test -p risingwave_meta deprecated_table_change_logs_are_ignored
• cargo test -p risingwave_meta manager::transaction::tests
• cargo test -p risingwave_hummock_test test_iter_log
• cargo check -p risingwave_hummock_sdk -p risingwave_meta -p risingwave_storage -p risingwave_hummock_test --all-targets
• cargo clippy --all-targets --all-features
• bash -n ci/scripts/backwards-compat-test.sh e2e_test/backwards-compat-tests/scripts/utils.sh e2e_test/backwards-compat-tests/scripts/run_local.sh
• Parsed ci/workflows/pull-request.yml and ci/workflows/main-cron.yml as YAML.
• Verified backward-compatibility version selection for matrix offsets 1 through 4.
• Verified retry-until-success behavior for the RECOVER command.

Checklist

• I have written necessary rustdoc comments.
• I have added necessary unit tests and integration tests.
• I have added test labels as necessary.
• I have added fuzzing tests or opened an issue to track them.
• My PR contains breaking changes.
• My PR changes performance-critical code, so I will run (micro) benchmarks and present the results.
• I have checked the Release Timeline and Currently Supported Versions to determine which release branches I need to cherry-pick this PR into.

Documentation

• My PR needs documentation updates.

Release note

None. This is an internal storage metadata refactor.

[wenym1]

• refactor(storage): decouple table change logs from hummock versions #26561 👈 (View in Graphite)
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.