Note: This is a public test instance of Red Hat Bugzilla. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback at bugzilla.redhat.com.

Bug 1818006

Summary: pythran fails to build with Python 3.9: hundreds of test failures
Product: [Fedora] Fedora Reporter: Miro Hrončok <mhroncok>
Component: pythranAssignee: Miro Hrončok <mhroncok>
Status: CLOSED ERRATA QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 33CC: cstratak, fzatlouk, igor.raits, mhroncok, mplch, python-sig, sguelton
Target Milestone: ---Keywords: Reopened
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: AcceptedFreezeException
Fixed In Version: pythran-0.9.7-1.fc34 pythran-0.9.7-1.fc33 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-09-25 16:57:22 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1817713    
Bug Blocks: 1803234, 1803235, 1868279, 1766776, 1785415, 1787813    

Description Miro Hrončok 2020-03-27 12:26:18 UTC
pythran fails to build with Python 3.9.0a5.

...............F......F.....s..Fs.....s....F....FFFF..F....F..F......... [  2%]
..................s..........F........s............................F.... [  4%]
.....F.s.s...........F..................F...........................F... [  6%]
........F.F........F..F.F........F............FFF...F....F.....F....FF.F [  9%]
F.F.FFF...F.FFFFFFF.F.FF..F.FFFFFFF...Fs...Fs.FF.F.F.FF.F........F...... [ 11%]
..FFF.FsF..sFF.FF...F..FFFFFF....FF.F.F..F.F...F..F.FFF........s........ [ 13%]
..F................F..........F.F....................................... [ 16%]
....................................s........s.............s.s.Fs.F.F... [ 18%]
......s.s..ss...F.F.s.....F..F.F.........F.s.s..s....................... [ 20%]
..........................................s.................s........... [ 22%]
...............ss..............s.sssssssssss......s....ss........ssss..s [ 25%]
.......s....s........F.....sssss...F.........................F..F....... [ 27%]
..................................................FF.................... [ 29%]
...........F........F.........F..F......F......F.FFF............FFFF.FFF [ 32%]
F.FFFF..F........ss.........FFsssF.FFFF.FFF.FFFFF.FFFFF.FFFF..F......... [ 34%]
.........................................F..........FF....FF............ [ 36%]
......F.FFFFFF......s...............F......s.....................F..F.FF [ 38%]
..F....F.F.FFF................FFFFFF.FFFFFFFF.FFFF.......FF.FF...FFFF.FF [ 41%]
FF.FF.......F.....FF.....FFFF.FFFFF.FFF....F..FFFFF..FF.sssFFF..F.FF.... [ 43%]
.ss....s.....................................F.......................... [ 45%]
...F...........F........................................................ [ 48%]
..........FF.................................................F.......... [ 50%]
................F.................F..................................... [ 52%]
........................................................................ [ 54%]
..FF..F..........F.......F....F.F....................................... [ 57%]
..................................................FFF................... [ 59%]
..............................................F......................... [ 61%]
.............................................F.......................... [ 64%]
........................................................................ [ 66%]
........................................................................ [ 68%]
........................................................................ [ 70%]
........................................................................ [ 73%]
........................................................................ [ 75%]
..........................................s............................. [ 77%]
...............................s...............................sss...... [ 80%]
............................................................F.......F... [ 82%]
.F.........F.........................F....FF.F.......................... [ 84%]
.......s..F............................................................. [ 86%]
.............s...........sFFF...s..sF...F.F..F.FF.FFsFFsFs..sF.FFFFFFFFF [ 89%]
F.s............F.....................F.....F..............F.....F.F..... [ 91%]
...F.F.F..F..F.F..F..F...F.F.FFFFFFF.FFFFF.FFFFFFFFFFFFFF.............FF [ 93%]
..F.FF.F.F..F.F..FF..F.F.............ss.......ss......F.FF......FFF..F.. [ 96%]
.F.F.......FF.F.......F..............................F.................. [ 98%]
....................................F................                    [100%]
===== 367 failed, 2694 passed, 88 skipped, 523 warnings in 6596.69 seconds =====


For the build logs, see:
https://copr-be.cloud.fedoraproject.org/results/@python/python3.9/fedora-rawhide-x86_64/01321628-pythran/

For all our attempts to build pythran with Python 3.9, see:
https://copr.fedorainfracloud.org/coprs/g/python/python3.9/package/pythran/

Testing and mass rebuild of packages is happening in copr. You can follow these instructions to test locally in mock if your package builds with Python 3.9:
https://copr.fedorainfracloud.org/coprs/g/python/python3.9/

Let us know here if you have any questions.

Python 3.9 will be included in Fedora 33. To make that update smoother, we're building Fedora packages with early pre-releases of Python 3.9.
A build failure prevents us from testing all dependent packages (transitive [Build]Requires), so if this package is required a lot, it's important for us to get it fixed soon.
We'd appreciate help from the people who know this package best, but if you don't want to work on this now, let us know so we can try to work around it on our side.

Comment 1 serge_sans_paille 2020-04-17 13:35:28 UTC
It's probably due to the lack of support of python 3.9 in gast. I'll have a look.

Comment 2 Miro Hrončok 2020-05-25 13:02:03 UTC
This comment is mass posted to all bugs blocking the Python 3.9 tracker, sorry if it is not 100 % relevant. When in doubt, please ask.


The Python 3.9 rebuild is in progress in a Koji side tag.

If you fix this bug, please don't rebuild the package in regular rawhide, but do it in the side tag with:

    $ fedpkg build --target=f33-python

The rebuild is progressing slowly and it is possible this package won't have all the required build dependencies yet. If that's the case, please just leave the fix committed and pushed and we will eventually rebuild it for you.

You are not asked to go and try rebuild all the missing dependencies yourself. If you know there is a bootstrap loop in the dependencies, let me know and we can untangle it together.

If you want to test your fix or reproduce the failure, you can still use the Copr repo mentioned in the initial comment of this bug: https://copr.fedorainfracloud.org/coprs/g/python/python3.9/

Comment 3 Miro Hrončok 2020-05-29 07:11:54 UTC
Python 3.9 update: The f33-python side tag is currently being merged.

New builds in f33-python are no longer possible, but python3 is not yet updated to Python 3.9 in rawhide. You can check when Python is Python 3.9 with:

    $ koji wait-repo f33-build --build python3.9-3.9.0~b1-3.fc3

And build the packages normally after that.

Comment 4 Miro Hrončok 2020-05-29 15:06:22 UTC
*** Bug 1841806 has been marked as a duplicate of this bug. ***

Comment 6 Miro Hrončok 2020-05-29 19:43:36 UTC
I'll work on this later.

Comment 7 Miro Hrončok 2020-08-07 12:57:01 UTC
A release of Pythran that supports Python 3.9 is anticipated in September.

Comment 8 Ben Cotton 2020-08-11 13:15:32 UTC
This bug appears to have been reported against 'rawhide' during the Fedora 33 development cycle.
Changing version to 33.

Comment 9 Miro Hrončok 2020-08-22 10:30:40 UTC
Hello. This comment is mass posted to all 16 bugzillas for packages that failed to rebuild with Python 3.9 (and, in most cases, also fail to install on Fedora 33 and 34). Apologies if some of the suggestions or questions don't apply 100%.

Fedora 33 Beta Freeze starts next week on Tuesday, 2020-08-25. I haven't spammed this bugzilla because it is in ASSIGNED, or I've seen upstream has been notified.

Please consider what to do here. Is this failure critical? For example, can a test be temporarily skipped to make this package build? Is it possible to fix or workaround the failure before Fedora 33 Beta? Or before Fedora 33 Final? If not, would it make sense to retire the package (even temporarily) before the release to unblock updates from Fedora 31 or Fedora 32?

In case you need any assistance with a Python-related problem with the build, don't hesitate to let me know and I'll try to have a look.

Thank you!

Comment 10 Miro Hrončok 2020-08-24 09:07:21 UTC
*** Bug 1871611 has been marked as a duplicate of this bug. ***

Comment 11 serge_sans_paille 2020-09-23 06:46:16 UTC
0.9.7 is officially out and thanks to your effort, @miro, it should pass the validation :-)

Comment 12 Fedora Blocker Bugs Application 2020-09-23 08:30:36 UTC
Proposed as a Freeze Exception for 33-beta by Fedora user churchyard using the blocker tracking app because:

 The package does not install without the proposed update.

Comment 14 Miro Hrončok 2020-09-23 10:11:21 UTC
Unfortunately, it seems that https://github.com/serge-sans-paille/pythran/pull/1640 is not part of the new release :/

I'll patch it locally.

Comment 15 Fedora Update System 2020-09-23 21:52:36 UTC
FEDORA-2020-5955892ddc has been submitted as an update to Fedora 33. https://bodhi.fedoraproject.org/updates/FEDORA-2020-5955892ddc

Comment 16 Fedora Update System 2020-09-24 09:03:52 UTC
FEDORA-2020-0b5d872922 has been pushed to the Fedora 34 stable repository.
If problem still persists, please make note of it in this bug report.

Comment 17 František Zatloukal 2020-09-24 11:58:38 UTC
Setting as AcceptedFE as per voting: https://pagure.io/fedora-qa/blocker-review/issue/121

Comment 18 Fedora Update System 2020-09-25 16:57:22 UTC
FEDORA-2020-5955892ddc has been pushed to the Fedora 33 stable repository.
If problem still persists, please make note of it in this bug report.