Skip to content

[flink] Fix batch database compaction for Data Evolution tables - #10110

Open
tzphh wants to merge 1 commit into
apache:masterfrom
tzphh:codex/fix-data-evolution-db-compaction
Open

tzphh wants to merge 1 commit into
apache:masterfrom
tzphh:codex/fix-data-evolution-db-compaction

Conversation

@tzphh

@tzphh tzphh commented Sep 22, 2026

Copy link
Copy Markdown

Purpose

Fixes #10102.

Fix batch compact_database routing for Data Evolution tables.
The ordinary append compaction path reads partial-column files separately,
which can fail when a file omits a NOT NULL column.

Reuse DataEvolutionTableCompact in divided mode. In batch combined mode,
route Data Evolution tables to dedicated compactors while keeping other
tables on the existing combined path.

Tests

Add regression coverage in CompactDatabaseActionITCase for:

  • Partial-column updates that omit a NOT NULL column.
  • Batch divided and combined modes.
  • Mixed ordinary append and Data Evolution tables.
  • Data Evolution-only databases, empty tables, and table filtering.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] Flink compact_database uses ordinary append compaction for Data Evolution tables

1 participant