[WIP][SPARK-XXXXX][SQL][TESTS] Refactor some DSv2 tests to use SessionQueryTest#56708

Open

fwc wants to merge 59 commits into

apache:masterfrom

fwc:refactor-some-tests-to-sessionquerytest

Commits on Jun 9, 2026

Add classic.SparkSessionProvider
Matthis Gördel
committed
Move test.SharedSparkSessionBase functionality to sql.SharedSparkSession
Matthis Gördel
committed
[API CHANGE]: Move doThreadPreAudit, doThreadPostAudit to sql.SharedSparkSession
Matthis Gördel
committed
Rename sql.SharedSparkSession to sql.SparkSessionBinder to prevent shadowing
Matthis Gördel
committed
Deprecate test.SharedSparkSession
Matthis Gördel
committed
Add connect.SparkSession{Provider,Binder}, connect.QueryTest and demo
Matthis Gördel
committed
Add classic.SparkSessionBinder with usage demonstration
Matthis Gördel
committed
fixup: fix compile error
Matthis Gördel
committed
Restructure so that SparkSessionBinder implements QueryTest, address nits
Matthis Gördel
committed
fixup
Matthis Gördel
committed
Have SharedSparkSession as empty alias of classic.SparkSessionBinder
Matthis Gördel
committed
fixup
Matthis Gördel
committed
partial refactor of connect/classic test
Matthis Gördel
committed
rest of refactor
Matthis Gördel
committed
Add example suite
Matthis Gördel
committed
Minimize sql.SparkSessionBinder stuff
Matthis Gördel
committed
WIP
Matthis Gördel
committed
WIP: partially refactor DSv2IncrementallyConstructedQueryTests.scala
Matthis Gördel
committed

Commits on Jun 10, 2026

Remove extra checkAnswer helpers to have on thing to override
Matthis Gördel
committed
Add SessionQueryTest::sessionType
Matthis Gördel
committed
Fix DSv2ExternalMutationTestBase by replacing 'isConnect' with sessionType and by implementing QueryTest
Matthis Gördel
committed
Remove unused imports
Matthis Gördel
committed
WIP
Matthis Gördel
committed

Commits on Jun 12, 2026

reset connect session in beforeEach/afterEach
Matthis Gördel
committed
Shutdown SparkConnectServer at end of afterAll, don't silence shutdown exceptions
Matthis Gördel
committed
fix server session access in DataSourceV2DataFrameConnectSuite
Matthis Gördel
committed

Commits on Jun 15, 2026

Extract CheckError into CheckErrorHelper
Matthis Gördel
committed
smash
Matthis Gördel
committed
add, fix scaladoc
Matthis Gördel
committed
Update, extend deprecation annotations
Matthis Gördel
committed
Add missing newline at EOF
Matthis Gördel
committed

Commits on Jun 16, 2026

Remove unused import
Matthis Gördel
committed

Commits on Jun 17, 2026

Merge branch 'master' into sharedsparksession-refactor-mostly-nonbreaking
Matthis Gördel
committed

Commits on Jun 22, 2026

fixup: CheckErrorHelper
Matthis Gördel
committed
Only use SessionQueryTestBase in DSv2ExternalMutationTestBase
Matthis Gördel
committed
Add SQLConfHelper to SessionQueryTestBase
Matthis Gördel
committed
Fix QueryTest::checkAnswer
Matthis Gördel
committed
Catch analysis-time failure in CheckAnswerHelper
Matthis Gördel
committed
CheckAnswerHelper: limit df.queryExec access to classic dfs
Matthis Gördel
committed
fix grammar
Matthis Gördel
committed
fix capitalization
Matthis Gördel
committed
docstring fix
Matthis Gördel
committed
Don't add hive.SessionQueryTest (yet)
Matthis Gördel
committed
Add docstring for connect.SessionQueryTest::isDfSorted
Matthis Gördel
committed
Document that SparkSessionBinderBase is temporary
Matthis Gördel
committed

Commits on Jun 23, 2026

use precomputed analyzedDF instead of df in checkAnswer
Leonid Lygin
committed
make connect.SparkSessionBinder::classicSession private
Matthis Gördel
committed
fixup: rename
Matthis Gördel
committed
add example testcase with conf stuff
Matthis Gördel
committed
SessionQueryTestBase declares 'withConf' instead of extending SQLConfHelper
Matthis Gördel
committed
add connect isDfSorted and connect.DataFrame::explainString
Matthis Gördel
committed
fixup! add connect isDfSorted and connect.DataFrame::explainString
Matthis Gördel
committed
fixup! add connect isDfSorted and connect.DataFrame::explainString
Matthis Gördel
committed
deprecate rarely used method in SharedSparkSession
Matthis Gördel
committed
WIP: provide isDfSorted override for connect
Matthis Gördel
committed
fixup! add connect isDfSorted and connect.DataFrame::explainString
Matthis Gördel
committed
Don't deprecate SharedSparkSession[Base] yet
Matthis Gördel
committed
Don't refactor DSv2 classic/connect tests (yet)
Matthis Gördel
committed
refactor some DSv2 classic/connect tests to use SessionQueryTest
Matthis Gördel
committed