Bug 2107826

This is because Python 3.11.0b4 has updated the pyc magic number: https://github.com/python/cpython/blob/v3.11.0b4/Lib/importlib/_bootstrap_external.py#L406

Thanks for checking. If this is critical for you, rebuild pycparsing. Otherwise, I'd like the Fedora 37 mass rebuild [1] to handle things before we take any mass action.

See also bz1748018.


[1] Wed 2022-07-20 https://fedorapeople.org/groups/schedule/f-37/f-37-key-tasks.html

The mass rebuild is over, let's check what remains to be rebuilt.

3.11.0b5 is released and according to https://github.com/python/cpython/blob/v3.11.0b5/Lib/importlib/_bootstrap_external.py#L406 the magic number remains unchanged.

I still see

/usr/lib64/python3.11/site-packages/systemd/__pycache__/__init__.cpython-311.pyc
/usr/lib64/python3.11/site-packages/systemd/__pycache__/daemon.cpython-311.pyc

getting rebuilt in runtime, for the FreeIPA server use case: https://github.com/adelton/freeipa-container/runs/7573207697?check_suite_focus=true.

It seems that python3-psutil might also need the rebuild, seeing also

/usr/lib64/python3.11/site-packages/psutil/__pycache__/__init__.cpython-311.pyc
/usr/lib64/python3.11/site-packages/psutil/__pycache__/_pslinux.cpython-311.pyc
/usr/lib64/python3.11/site-packages/psutil/__pycache__/_common.cpython-311.pyc
/usr/lib64/python3.11/site-packages/psutil/__pycache__/_compat.cpython-311.pyc
/usr/lib64/python3.11/site-packages/psutil/__pycache__/_psposix.cpython-311.pyc

show up in a slightly different test scenario.

Yes, python-systemd and python-psutil both failed to rebuild. So did many others. We will track the remaining failures -- once releng opens FTBFS bugzillas, we will mark them as blocking this one. Please, don't comment here for every single individual package that has failed the mass rebuild, it will likely be at least a hundred.

If you care about python-systemd and python-psutil, you can file the FTBFS bugzillas for them before releng does. Just make sure they block this bugzilla and the F37FTBFS tracker.

Here is the list of failed packages that need to be rebuilt. 

    "torebuild": [
        "bind",
        "capstone",
        "copr-keygen",
        "crypto-policies",
        "csound",
        "espresso",
        "fedmsg",
        "future",
        "gnome-builder",
        "grass",
        "libsbml",
        "link-grammar",
        "lldb",
        "net-snmp",
        "osbs-client",
        "pesign",
        "psi4",
        "pungi",
        "pybind11",
        "python-APScheduler",
        "python-TestSlide",
        "python-astropy",
        "python-databases",
        "python-dirq",
        "python-django-pyscss",
        "python-enrich",
        "python-fasjson-client",
        "python-gear",
        "python-httpretty",
        "python-igor",
        "python-ipyparallel",
        "python-jedi",
        "python-jsons",
        "python-m2r",
        "python-mplcursors",
        "python-networkx",
        "python-neutronclient",
        "python-nose2",
        "python-numpydoc",
        "python-odml",
        "python-owl_rl",
        "python-pandas",
        "python-patsy",
        "python-pecan-notario",
        "python-pikepdf",
        "python-pingouin",
        "python-psutil",
        "python-pybids",
        "python-pycdlib",
        "python-pymatreader",
        "python-pynwb",
        "python-pysam",
        "python-pyunicorn",
        "python-reportlab",
        "python-socks",
        "python-sphinx-panels",
        "python-systemd",
        "python-typish",
        "python-vdf",
        "python-websockets",
        "python-wsaccel",
        "python-xarray",
        "resalloc",
        "restview",
        "rpy",
        "veusz",
        "xapian-bindings"
    ]

Bugzillas for packages below weren't opened yet.

        "fedmsg",
        "link-grammar",
        "lldb",
        "osbs-client",
        "pesign",
        "pungi",
        "pybind11",
        "python-fasjson-client",
        "python-gear",
        "python-neutronclient",
        "python-nose2",
        "python-pikepdf",
        "python-psutil",
        "python-pycdlib",
        "python-pynwb",
        "python-pysam",
        "restview",

The following packages appear to be rebuilt in the meantime:

link-grammar https://koji.fedoraproject.org/koji/buildinfo?buildID=2040588 --should be OK
pesign https://koji.fedoraproject.org/koji/buildinfo?buildID=2020730 -- pesign is special, it requires signing permission to tag to rawhide, we need to ask the maintainers or releng


The following packages are listed at https://kojipkgs.fedoraproject.org/mass-rebuild/f37-failures.html but we see no F37FTBFS bugzilla:

fedmsg
lldb
pungi
pybind11
python-fasjson-client
python-nose2
python-pikepdf
python-psutil
python-pycdlib
python-pynwb
restview


The rest probably failed to even build SRPM and is only listed at https://kojipkgs.fedoraproject.org/mass-rebuild/f37-need-rebuild.html

osbs-client
python-gear
python-neutronclient

osbs-client -- releng script has not incremented the release correctly: https://src.fedoraproject.org/rpms/osbs-client/c/9fcd8043e4bf26f9f1ef92176bf1d2c6a5c0c667?branch=rawhide -- attempted fix in https://src.fedoraproject.org/rpms/osbs-client/pull-request/10


The following two builds hanged and were eventually cancelled:

python-gear --https://koji.fedoraproject.org/koji/buildinfo?buildID=2022987
python-neutronclient -- https://koji.fedoraproject.org/koji/buildinfo?buildID=2023678

(In reply to Miro Hrončok from comment #10)
> osbs-client -- releng script has not incremented the release correctly:
> https://src.fedoraproject.org/rpms/osbs-client/c/
> 9fcd8043e4bf26f9f1ef92176bf1d2c6a5c0c667?branch=rawhide -- attempted fix in
> https://src.fedoraproject.org/rpms/osbs-client/pull-request/10

Merged and built.

All bugzillas open. pybind11 was built in the meantime.

(In reply to Miro Hrončok from comment #9)
> pesign https://koji.fedoraproject.org/koji/buildinfo?buildID=2020730 --
> pesign is special, it requires signing permission to tag to rawhide, we need
> to ask the maintainers or releng

pesign was rebuilt and the maintainer added "noautobuild" file into the dist-git.

https://koji.fedoraproject.org/koji/buildinfo?buildID=2040965

This bug appears to have been reported against 'rawhide' during the Fedora Linux 37 development cycle.
Changing version to 37.

Here is the current list of failed packages that need to be rebuilt:

    "torebuild": [
        "capstone",
        "copr-keygen",
        "csound",
        "fedmsg",
        "psi4",
        "python-APScheduler",
        "python-astropy",
        "python-databases",
        "python-enrich",
        "python-fasjson-client",
        "python-jsons",
        "python-nose2",
        "python-numpydoc",
        "python-odml",
        "python-pandas",
        "python-pecan-notario",
        "python-pybids",
        "python-pycdlib",
        "python-pysam",
        "python-pyunicorn",
        "python-typish",
        "python-xarray",
        "resalloc",
        "restview",
        "rpy"
    ]

All packages have open bugzillas. We're no longer tracking this so I'm closing the tracker.