Addressing ptest failures for multiple packages

[kgodara912]

Merge Checklist

All boxes should be checked before merging the PR (just tick any boxes which don't apply to this PR)

• The toolchain has been rebuilt successfully (or no changes were made to it)
• The toolchain/worker package manifests are up-to-date
• Any updated packages successfully build (or no packages were changed)
• Packages depending on static components modified in this PR (Golang, *-static subpackages, etc.) have had their Release tag incremented.
• Package tests (%check section) have been verified with RUN_CHECK=y for existing SPEC files, or added to new SPEC files
• All package sources are available
• cgmanifest files are up-to-date and sorted (./cgmanifest.json, ./toolkit/scripts/toolchain/cgmanifest.json, .github/workflows/cgmanifest.json)
• LICENSE-MAP files are up-to-date (./LICENSES-AND-NOTICES/SPECS/data/licenses.json, ./LICENSES-AND-NOTICES/SPECS/LICENSES-MAP.md, ./LICENSES-AND-NOTICES/SPECS/LICENSE-EXCEPTIONS.PHOTON)
• All source files have up-to-date hashes in the *.signatures.json files
• sudo make go-tidy-all and sudo make go-test-coverage pass
• Documentation has been updated to match any changes to the build system
• Ready to merge

---

Summary

Fix failing core ptest across packages

Summary

Summary

Bumps Release and adds a changelog entry on every affected spec. Per-spec rationale:

• atftp — drop %check entirely (set to :). Upstream test/test.sh is an interactive end-to-end network test (sudo+tmpfs, multiple SSH hosts for multicast) and is not runnable in a non-interactive build chroot. Upstream's own redhat/atftp.spec.in ships no %check for the same reason. Also add pcre2-devel BR and --enable-libpcre.
• debugedit — replace the broken %make_build_check macro with an explicit make %{?_smp_mflags} check in %check so the test target actually runs.
• dtc — add fix-check-err-tuple.patch to handle SWIG returning a tuple instead of an integer from fdt_get_mem_rsv in pylibfdt (make check itself is unchanged).
• fakeroot — split the obj-sysv and obj-tcp test runs and retry the tcp variant once to ride out intermittent t.tar failures in the chroot; also move COPYING from %doc to %license so the toolkit license-checker no longer flags it.
• fillup — drop %{?_smp_mflags} from make test in %check; the test target is not parallel-safe.
• future — add future-fix-imp-removal.patch (fall back to importlib when the imp module is unavailable, Python 3.12+); expand the pytest -k exclusion list and add 10 --ignore entries for test modules that still depend on imp or stdlib modules removed in 3.12.
• keyutils — tolerate make -k test; the keyctl/requesting/valid case invokes the kernel request_key callout which spawns /sbin/request-key in the host pid/mount namespace and cannot see the chroot-installed binary. The other ~140 tests pass.
• libtool — run make check with TESTSUITEFLAGS='1-65 67-168' to skip exactly test 66 (link-order, broken with binutils >= 2.39 — debbugs #58105) and test 169 (cmdline_wrap, which cascades from any earlier failure including 66). Any other regression still hard-fails the build.
• m2crypto — replace deprecated setup.py test with pytest, copy system six over the bundled M2Crypto/six.py so the test run surfaces the real underlying error in the log, and tolerate (|| :) because M2Crypto 0.38.0 has two upstream incompatibilities with Python 3.12 that cannot be fixed at the spec level: (1) the bundled six.moves lazy importer is broken by 3.12 importlib changes, and (2) SSL/ssl_dispatcher.py imports asyncore, which was removed by PEP 594. These are fixed in M2Crypto >= 0.40; the day this package is rebased, %check becomes meaningful with no further work. Add python3-pytest and python3-six BRs.
• man-db — make check XFAIL_TESTS="man1/lexgrog.1"; the lexgrog.1 page trips groff's line-adjust check due to the missing CW (constant-width) font in the build chroot. The other 11 man-page tests still hard-fail on regression.
• nbdkit — add the missing tests/test-blocksize-extents-overflow.sh (completes the CVE-2025-47712 backport — without it make check aborted with No rule to make target); skip 10 chroot-incompatible tests (5 TLS — Azure Linux gnutls 3.8.x rejects the test PKI; 3 OCaml — 1.35.3's OCaml plugin is incompatible with ocaml 5.x multicore; 2 file-plugin dir-mode — upstream free(): invalid pointer under MALLOC_CHECK_=1) and XFAIL test-ocaml-errorcodes.
• perl-List-MoreUtils — drop the cpan -i List::MoreUtils::XS bootstrap from %check (XS package is not available in the build env) and run only the pure-perl tests via make test TEST_FILES="t/pureperl/*.t".
• python-astunparse — replace deprecated setup.py test with pytest and deselect tests/test_unparse.py::UnparseTestCase::test_files; astunparse 1.6.3 has no _Match handler for the Python 3.10+ match-statement AST. All other tests still hard-fail. Add python3-pytest BR.
• python-cherrypy — enumerate 11 specific --deselects in the tox invocation (multipart-form half-close timing, timing-sensitive bus/conn/gc tests, range-header parsing, SIGHUP-daemonized reload). All other test failures still hard-fail.
• python-coverage — the previous pip3 install -r requirements/dev.pip; tox chain silently ran zero tests (the rpm-installed pip has no RECORD file, so the install aborted before tox was present). Replace it with a direct pytest invocation: build the encoded-source zip via igor.py zip_mods, copy the built CTracer .so into the source tree so COVERAGE_CORE=ctrace resolves correctly, ignore 4 test modules (test_concurrency.py and test_oddball.py import flaky which lives in SPECS-EXTENDED and can't be a core BR; test_process.py and test_venv.py need subprocesses / virtualenv) and deselect 10 environment-dependent tests. Add python3-execnet, python3-hypothesis, python3-pytest-xdist, python3-sortedcontainers BRs.
• python-distlib — extend the existing pytest -k exclusion to also skip test_package_data; depends on package-data layout that is not reliable in the build env.
• python-fields — pin pytest>=5.4.0,<9 in the %check bootstrap; pytest 9.x rejects duplicate parametrize IDs (test_tuple_pickle uses loads twice).
• python-gevent — replace %tox || : with proper scoped exclusions via an updated skip-irrelevant-tests.patch: (1) add 2 atexit-sensitive stdlib tests to gevent's native disabled_tests list, (2) decorate one timing-flaky core test with @unittest.skip, (3) neutralize TestEtcHosts (synthetic resolver comparison that recurses in restricted DNS environments), (4) bump per-file test timeout 100s → 300s, (5) skip the monkey-patched stdlib test_socket.py entirely (upstream itself flags it as flaky under monkey-patching). %tox now runs clean — no || :.
• python-google-pasta — replace deprecated setup.py test with pytest; exclude PrefixSuffixGoldenTest (51 failures from Python 3.12 AST changes) and the fstring / inline_* tests that error from the same AST changes. Add python3-pip BR.
• python-logutils — patch tests for Python 3.12 compatibility in %prep (replace assertEquals with assertEqual in test_dictconfig.py; add explicit l.setLevel(logging.WARNING) in test_adapter.py, test_testing.py, test_queue.py).
• python-markdown — pass lowercase %{pkgname} to %autosetup -n so the source dir matches markdown-3.8.2; rename two test methods (test_raw_missing_close_bracket, test_unclosed_comment_*) to skip them — both fail due to Python 3.12 html.parser behaviour changes.
• python-pbr — tox 3.x + virtualenv 21.x can no longer editable-install pbr from source under modern setuptools. Replace tox with a direct stestr invocation and exclude 5 tests (test_freeze_command, test_console_script_{develop,install}, test_pep_517_support, test_requirement_parsing) that recursively pip-install pbr-from-source inside a PEP 517 isolated env where pbr's setup.py cannot find itself. Fixed upstream in pbr >= 6.1. Add python3-virtualenv and python3-wheel BRs.
• python-pexpect — patch tests to use assertRaisesRegex (assertRaisesRegexp was removed in Python 3.12); --ignore test_pxssh.py (needs an SSH server) and test_async.py (uses asyncio.coroutine, removed in 3.12).
• python-pycodestyle — pin packaging==23.2 in the test bootstrap to avoid the uninstall conflict with the system RPM-managed packaging.
• python-pytest-benchmark — pip3 install -e . so the pytest plugin entry point is discovered; suppress ast.Str DeprecationWarning; extend the -k exclusion list with 10 more tests broken by Python 3.12 CodeType / pytest output-format differences.
• python-remoto — rename def setup(self) → def setup_method(self) in test_process.py / test_util.py; newer pytest no longer auto-invokes setup on plain (non-unittest) classes.
• python-responses — pin packaging==23.2 in %check to avoid the uninstall conflict with the system RPM-managed packaging.
• python-routes — pin packaging==23.2 and drop the tox==3.4.0 pin (tox 4.x is required for the py312 environment).
• python-setuptools_scm — pin packaging==23.2 in %check to avoid the uninstall conflict with the system RPM-managed packaging.
• python-sphinx — add python3-filelock BR (two test modules failed pytest collection without it); drop the unreliable pip install --upgrade bootstrap (rpm-installed pip has no RECORD file); extend --ignore with three more modules that depend on html5lib via docutils (test_build_texinfo, test_domain_std, test_smartquotes — html5lib cannot be a core BR because its transitive webencodings dep lives in SPECS-EXTENDED); deselect 7 version-specific tests (test_enum_class, test_autodoc_type_aliases, test_autodoc_default_options, test_viewcode, test_viewcode_linenos, two test_intl translation cases) that are fixed in later Sphinx releases. Any other failure still hard-fails.
• python-sqlalchemy — sed-patch lib/sqlalchemy/util/_concurrency_py3k.py to create a new event loop when none is running (Python 3.12 deprecated get_event_loop()); pass --ignore=test/ext/mypy --ignore=test/typing/test_mypy.py (version-specific mypy output mismatches); drop the redundant doc/copyright.html HTML rendering of LICENSE and add %license LICENSE to the -doc subpackage so the toolkit license-checker no longer flags it.
• python-toolz — replace nosetests with pytest (nose is incompatible with Python 3.12 — no imp module); pin packaging==23.2; exclude test_inspect_wrapped_property (Python 3.12 inspect behaviour change).
• python-tox-current-env — install packaging==23.2 (avoid uninstall conflict) and tolerate tox -e py%{python3_version_nodots} because 177 of 185 integration tests invoke tox internally, which itself fails inside the build chroot.
• python-tqdm — --ignore=tests/tests_pandas.py; the file uses pandas.core.common.is_builtin_func which was removed in newer pandas releases.
• python-twisted — the full upstream tox -e nocov-posix-alldeps suite (>10000 tests) repeatedly hangs in CI past 5h on conch/names/dns/process/multicast modules with no captured culprit. Replace it with a curated trial smoke-test subset on 7 pure-logic modules (test_compat, test_error, test_cooperator, test_paths, test_text, test_strerror, test_randbytes — ~200 unit tests, no network, no spawned children, no privileged sockets, no extra PyPI deps). Drop the BRs and setup steps (pip, sudo, net-tools, tzdata, git, multicast route, test user) that only existed to bootstrap tox; add python3-attrs, python3-constantly, python3-hyperlink, python3-typing-extensions BRs that trial needs to import twisted. Once we upgrade the package, we can revert this.
• python-urllib3 — pin pytest>=7.4.0,<9 in the %check bootstrap; pytest 9.x rejects non-Collection iterables (itertools.chain) in parametrize argvalues used by the urllib3 test suite.

Testing

Each spec was rebuilt locally with:

sudo make build-packages REBUILD_TOOLS=y \
     PACKAGE_BUILD_LIST=<pkg> PACKAGE_REBUILD_LIST=<pkg> \
     SRPM_PACK_LIST=<pkg> ALLOW_TOOLCHAIN_REBUILDS=y RUN_CHECK=y

and the ptest log was inspected to confirm only the intended skips / XFAILs trigger and that no real regression is masked.

Change Log

Does this affect the toolchain?

YES

[kgodara912]

Buddy build

[kgodara912]

Buddy build
For twisted: Buddy build

[Copilot]

Pull request overview

This pull request addresses widespread package test (%check/ptest) failures across the Azure Linux packaging repo by updating spec files to make test execution reliable in the RPM build chroot (via targeted skips/deselects/patches and dependency tweaks), while also bumping Release where needed and updating toolchain manifests accordingly.

Changes:

• Adjust %check sections across many specs (pinning test deps, switching test runners, adding targeted ignores/deselects/XFAILs, and patching tests for Python 3.12 compatibility).
• Add/refresh downstream patches and spec metadata (e.g., missing test files for an nbdkit CVE backport; gevent, future, dtc compatibility fixes).
• Update toolchain/pkggen manifests to reflect the updated Release of impacted toolchain components.

Reviewed changes

Copilot reviewed 44 out of 44 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
toolkit/resources/manifests/package/toolchain_x86_64.txt	Updates toolchain manifest entries for debugedit/libtool/libltdl release bumps.
toolkit/resources/manifests/package/toolchain_aarch64.txt	Updates toolchain manifest entries for debugedit/libtool/libltdl release bumps.
toolkit/resources/manifests/package/pkggen_core_x86_64.txt	Updates core pkggen manifest for libtool/debugedit/libltdl release bumps.
toolkit/resources/manifests/package/pkggen_core_aarch64.txt	Updates core pkggen manifest for libtool/debugedit/libltdl release bumps.
SPECS/python-urllib3/python-urllib3.spec	Pins pytest <9 during %check to keep urllib3 tests running under newer pytest behavior.
SPECS/python-twisted/python-twisted.spec	Replaces long/hanging tox suite with a curated trial smoke subset; adjusts BRs.
SPECS/python-tqdm/python-tqdm.spec	Ignores pandas-dependent tests broken by pandas API removals.
SPECS/python-tox-current-env/python-tox-current-env.spec	Pins packaging in %check and tolerates tox failures due to chroot-incompatible integration tests.
SPECS/python-toolz/python-toolz.spec	Replaces nose with pytest for Python 3.12; pins packaging and excludes a known-broken test.
SPECS/python-sqlalchemy/python-sqlalchemy.spec	Patches async event-loop behavior for Python 3.12; drops doc copyright html; ignores mypy tests.
SPECS/python-sphinx/python-sphinx.spec	Adds filelock BR; removes unreliable pip-upgrade bootstrap; expands ignore/deselect lists.
SPECS/python-setuptools_scm/python-setuptools_scm.spec	Pins packaging in %check to avoid conflicts with RPM-managed packaging.
SPECS/python-routes/python-routes.spec	Pins packaging and unpins tox to allow tox 4 for py312 environment.
SPECS/python-responses/python-responses.spec	Pins packaging in %check to avoid conflicts with RPM-managed packaging.
SPECS/python-remoto/python-remoto.spec	Sed-patches tests for newer pytest setup semantics.
SPECS/python-pytest-benchmark/python-pytest-benchmark.spec	Installs editable to expose plugin entry points; suppresses warnings and excludes broken tests.
SPECS/python-pycodestyle/python-pycodestyle.spec	Pins packaging in %check to avoid conflicts with RPM-managed packaging.
SPECS/python-pexpect/python-pexpect.spec	Patches asserts for Python 3.12; ignores tests requiring SSH/removed asyncio APIs.
SPECS/python-pbr/python-pbr.spec	Replaces tox with direct stestr; adds BRs and excludes self-bootstrap tests.
SPECS/python-markdown/python-markdown.spec	Sed-skips a couple tests broken by Python 3.12 html.parser behavior changes.
SPECS/python-logutils/python-logutils.spec	Sed-patches tests for Python 3.12 unittest/log-level behavior changes.
SPECS/python-google-pasta/python-google-pasta.spec	Switches %check to pytest and excludes tests broken by Python 3.12 AST changes.
SPECS/python-gevent/skip-irrelevant-tests.patch	Tightens gevent’s test exclusions/timeouts to stabilize suite in chroot.
SPECS/python-gevent/python-gevent.spec	Documents and applies the improved gevent test exclusions (replacing prior broad tolerance).
SPECS/python-fields/python-fields.spec	Pins pytest <9 during %check for duplicate parametrize-ID behavior changes.
SPECS/python-distlib/python-distlib.spec	Expands pytest exclusion set for env-dependent tests.
SPECS/python-coverage/python-coverage.spec	Replaces non-functional tox bootstrap with direct pytest run; adds BRs and ignores/deselects.
SPECS/python-cherrypy/python-cherrypy.spec	Adds an explicit list of tox deselects for chroot-specific failures.
SPECS/python-astunparse/python-astunparse.spec	Switches %check to pytest; deselects match-AST-related failure; adds pytest BR.
SPECS/perl-List-MoreUtils/perl-List-MoreUtils.spec	Removes unavailable XS bootstrap and runs only pure-perl tests.
SPECS/nbdkit/nbdkit.spec	Skips known chroot-incompatible tests; marks one OCaml test XFAIL; updates release.
SPECS/nbdkit/CVE-2025-47712.patch	Extends CVE backport patch to include a missing test script referenced by Makefile.
SPECS/man-db/man-db.spec	Marks a single groff/font-dependent manpage check as XFAIL.
SPECS/m2crypto/m2crypto.spec	Moves %check to pytest with documented Python 3.12 limitations; adds BRs and tolerates failures.
SPECS/libtool/libtool.spec	Skips only the known-broken tests via TESTSUITEFLAGS while keeping other regressions fatal.
SPECS/keyutils/keyutils.spec	Makes %check tolerant due to request_key host-namespace behavior.
SPECS/future/future.spec	Adds imp-removal patch for Python 3.12+; expands ignore/deselect set in %check.
SPECS/future/future-fix-imp-removal.patch	Implements imp→importlib fallback for Python 3.12+.
SPECS/fillup/fillup.spec	Disables parallel make flags for non-parallel-safe test target.
SPECS/fakeroot/fakeroot.spec	Splits/retries tcp test variant and fixes COPYING placement under %license.
SPECS/dtc/fix-check-err-tuple.patch	Fixes SWIG tuple return handling in pylibfdt wrapper to keep tests passing.
SPECS/dtc/dtc.spec	Adds the SWIG tuple-handling patch and bumps release.
SPECS/debugedit/debugedit.spec	Replaces a broken check macro with explicit make ... check.
SPECS/atftp/atftp.spec	Adds PCRE2 support and disables %check due to upstream tests being interactive/network-dependent.

[mfrw]

Hi sir, there are a few suggestion of duplicate use of python dependcies - rest the PR looks good.
Thank you for this - this is a massive effort :)
[sorry took a little more time to review - given the size of the change]

[mfrw]

This is a really good approach IMHO.