perf: run each unit-test shard in parallel with pytest-xdist - #39026

Draft

AhtishamShahid wants to merge 34 commits into

masterfrom

ahtishamshahid/ci-parallelize-unit-tests-xdist

Commits on Aug 25, 2026

perf: run each unit-test shard in parallel with pytest-xdist
AhtishamShahid
committed
0e40edd
fix: make ddt endpoint parameterization deterministic across processes
AhtishamShahid
committed
7388655
fix: stabilize remaining ddt test IDs across xdist workers
AhtishamShahid
committed
e583972
fix: distribute by file, not by class, to keep modulestore isolation LIFO
AhtishamShahid
committed
7f87370
fix: make modulestore and cache test isolation safe to unwind
AhtishamShahid
committed
7a55fa7
fix: unwind modulestore isolation even when teardown raises, and name the leaker
AhtishamShahid
committed
bd944fb
fix: delete the course before ending modulestore isolation, not after
AhtishamShahid
committed
f0919d5
chore: stop tracking unrelated local scratch files
AhtishamShahid
committed
06bd5f1
fix: survive a missing CONTENTSTORE, and attribute it to the test that caused it
AhtishamShahid
committed
2b5490a
chore: trace whoever deletes settings.CONTENTSTORE [temporary diagnostic]
AhtishamShahid
committed
d994bbc
chore: dump the whole settings chain, not just the bottom [temporary diagnostic]
AhtishamShahid
committed
819c036
chore: identify the override frame that masks CONTENTSTORE [temporary diagnostic]
AhtishamShahid
committed
4e08378
chore: record where each settings override frame is created [temporary diagnostic]
AhtishamShahid
committed
2b25ecf
chore: check whether CONTENTSTORE survives Django setup [temporary diagnostic]
AhtishamShahid
committed
0fb2f07
fix: don't strand cache isolation when starting modulestore isolation fails
AhtishamShahid
committed
8bf4d77
chore: remove the temporary diagnostics now that the cause is understood
AhtishamShahid
committed
cbf1626
perf: only run the migration check when migrations or models change
AhtishamShahid
committed
9120462
fix: satisfy ruff in the files this branch touches
AhtishamShahid
committed
ec1d551
fix: satisfy both linters on the CONTENTSTORE readability probe
AhtishamShahid
committed
7393cf4
perf: cache the migrated schema and tune MySQL for the migration check
AhtishamShahid
committed
04e2f62
perf: revert the MySQL tuning, keep the schema cache
AhtishamShahid
committed
e6610aa
fix: clear the rate-limit cache between login-related tests
AhtishamShahid
committed
1c70c7f
fix: give RecoverAccountTests a well-formed current request
AhtishamShahid
committed
d6c237b
fix: call super().setUp() in TestContentTypeGatingPartition
AhtishamShahid
committed
c552c26
fix: restore the previous crum request instead of clearing it
AhtishamShahid
committed
4dc68fa
fix: give the sandbox service tests contentstore isolation
AhtishamShahid
committed
36ad876
fix: give the content-gating partition tests the course modes they need
AhtishamShahid
committed
c066e7b
fix: don't fail a test from inside clear_caches()
AhtishamShahid
committed
48bf411

Navigation Menu

Uh oh!

perf: run each unit-test shard in parallel with pytest-xdist - #39026

perf: run each unit-test shard in parallel with pytest-xdist#39026
AhtishamShahid wants to merge 34 commits into
masterfrom
ahtishamshahid/ci-parallelize-unit-tests-xdist

Commits on Aug 25, 2026

perf: run each unit-test shard in parallel with pytest-xdist

fix: make ddt endpoint parameterization deterministic across processes

fix: stabilize remaining ddt test IDs across xdist workers

fix: distribute by file, not by class, to keep modulestore isolation LIFO

fix: make modulestore and cache test isolation safe to unwind

fix: unwind modulestore isolation even when teardown raises, and name the leaker

fix: delete the course before ending modulestore isolation, not after

chore: stop tracking unrelated local scratch files

fix: survive a missing CONTENTSTORE, and attribute it to the test that caused it

chore: trace whoever deletes settings.CONTENTSTORE [temporary diagnostic]

chore: dump the whole settings chain, not just the bottom [temporary diagnostic]

chore: identify the override frame that masks CONTENTSTORE [temporary diagnostic]

chore: record where each settings override frame is created [temporary diagnostic]

chore: check whether CONTENTSTORE survives Django setup [temporary diagnostic]

fix: don't strand cache isolation when starting modulestore isolation fails

chore: remove the temporary diagnostics now that the cause is understood

perf: only run the migration check when migrations or models change

fix: satisfy ruff in the files this branch touches

fix: satisfy both linters on the CONTENTSTORE readability probe

perf: cache the migrated schema and tune MySQL for the migration check

perf: revert the MySQL tuning, keep the schema cache

fix: clear the rate-limit cache between login-related tests

fix: give RecoverAccountTests a well-formed current request

fix: call super().setUp() in TestContentTypeGatingPartition

fix: restore the previous crum request instead of clearing it

fix: give the sandbox service tests contentstore isolation

fix: give the content-gating partition tests the course modes they need

fix: don't fail a test from inside clear_caches()

Commits on Aug 27, 2026

chore: drop the .gitignore entries for local scratch files

perf: split unit tests by measured duration instead of by directory

fix: expand the unit-test matrix to ten jobs, not one

fix: keep the enumerated suite paths; the repository roots are not equivalent

revert: go back to directory shards; pytest-split is slower here

fix: derive user ids in TestSafeSessionMiddleware instead of hard-coding 1 and 2