Skip to content

Expose Iceberg data file row positions - #71

Merged
osipovartem merged 1 commit into
embucket-sync-df55.0.0from
expose-row-position-df55
Sep 7, 2026
Merged

Expose Iceberg data file row positions#71
osipovartem merged 1 commit into
embucket-sync-df55.0.0from
expose-row-position-df55

Conversation

@osipovartem

Copy link
Copy Markdown

Summary

  • add an opt-in DataFusionTable configuration field for the existing Iceberg file row-position virtual column
  • map requested projections to the physical scan schema by field name so internal delete sequence columns cannot shift requested columns
  • keep the provider-side hidden field nullable for INSERT compatibility while scan values remain non-null
  • extend the hidden-column scan test to validate row positions

Validation

  • cargo +1.95.0 test --offline -p datafusion_iceberg test_datafusion_table_insert_with_data_file_path --lib
  • cargo +1.95.0 clippy --offline -p datafusion_iceberg --all-targets
  • cargo +1.95.0 fmt --all
  • git diff --check

@osipovartem
osipovartem merged commit 1b5df16 into embucket-sync-df55.0.0 Sep 7, 2026
2 checks passed
@osipovartem
osipovartem deleted the expose-row-position-df55 branch September 7, 2026 22:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant