Skip to content

fix: select prefix fragments for LIMIT queries#156

Open
LuciferYang wants to merge 1 commit into
lance-format:mainfrom
LuciferYang:fix/141-limit-prefix-fragment-selection
Open

fix: select prefix fragments for LIMIT queries#156
LuciferYang wants to merge 1 commit into
lance-format:mainfrom
LuciferYang:fix/141-limit-prefix-fragment-selection

Conversation

@LuciferYang

@LuciferYang LuciferYang commented Jun 8, 2026

Copy link
Copy Markdown
Contributor

Summary

  • select prefix fragment IDs for unfiltered LIMIT queries through LanceRuntime
  • avoid building full fragment id and row-count lists in the split manager
  • cover arbitrary LIMIT N pushdown and prefix fragment order

Scope

This is a narrow follow-up to #121. It does not avoid Lance's full Dataset.getFragments() enumeration, and it does not address filtered or aggregate LIMIT queries.

Verification

  • git diff --check
  • ./mvnw -pl plugin/trino-lance -Dtest=TestLanceSplitManager,TestLanceConnectorTest test

@LuciferYang LuciferYang marked this pull request as draft June 8, 2026 12:56
@LuciferYang LuciferYang force-pushed the fix/141-limit-prefix-fragment-selection branch from 1214564 to d807661 Compare June 8, 2026 13:09
@LuciferYang LuciferYang force-pushed the fix/141-limit-prefix-fragment-selection branch from d807661 to aa2e455 Compare June 8, 2026 13:12
@LuciferYang LuciferYang marked this pull request as ready for review June 8, 2026 13:15
@LuciferYang LuciferYang changed the title Optimize fragment selection for LIMIT queries fix: select prefix fragments for LIMIT queries Jun 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant