Skip to content

[WIP][SPARK-XXXXX][SQL][TESTS] Refactor some DSv2 tests to use SessionQueryTest#56708

Open
fwc wants to merge 59 commits into
apache:masterfrom
fwc:refactor-some-tests-to-sessionquerytest
Open

[WIP][SPARK-XXXXX][SQL][TESTS] Refactor some DSv2 tests to use SessionQueryTest#56708
fwc wants to merge 59 commits into
apache:masterfrom
fwc:refactor-some-tests-to-sessionquerytest

Conversation

@fwc

@fwc fwc commented Jun 23, 2026

Copy link
Copy Markdown

What changes were proposed in this pull request?

This PR builds upon #56190 and refactors the existing classic/connect-targeting DSv2 tests to use SessionQueryTest.

NOTE: this PR is stacked upon #56190 and WIP until that PR is merged and this PR is rebased. The actual changes are to the files in sql/core/src/test/scala/org/apache/spark/sql/connector/ and to sql/connect/server/src/test/scala/org/apache/spark/sql/connect/DataSourceV2DataFrameConnectSuite.scala (currently ea62c55)

Why are the changes needed?

This PR reduces the amount of custom test helpers.

Does this PR introduce any user-facing change?

No

How was this patch tested?

This patch is test-only

Was this patch authored or co-authored using generative AI tooling?

No

Matthis Gördel added 30 commits June 9, 2026 12:49
…parkSession

This is technically an 'api change' as it moves the thread audit stuff
from `test.SharedSparkSession` to `test.SharedSparkSessionBase`.

This breaks code that implements `SharedSparkSessionBase` to circumvent
the thread audit stuff.
Matthis Gördel and others added 29 commits June 15, 2026 18:31
@fwc fwc changed the title [SPARK-XXXXX][SQL][TESTS] Refactor some DSv2 tests to use SessionQueryTest [WIP][SPARK-XXXXX][SQL][TESTS] Refactor some DSv2 tests to use SessionQueryTest Jun 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant