Note: This is a public test instance of Red Hat Bugzilla. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback at bugzilla.redhat.com.
Bug 1792056 - python-billiard fails to build with Python 3.9: fork_exec() takes exactly 21 arguments (17 given)
Summary: python-billiard fails to build with Python 3.9: fork_exec() takes exactly 21 ...
Keywords:
Status: CLOSED RAWHIDE
Alias: None
Product: Fedora
Classification: Fedora
Component: python-billiard
Version: rawhide
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
Assignee: Fabian Affolter
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks: PYTHON39
TreeView+ depends on / blocked
 
Reported: 2020-01-16 23:01 UTC by Miro Hrončok
Modified: 2020-05-25 15:29 UTC (History)
10 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-05-25 13:00:57 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)

Description Miro Hrončok 2020-01-16 23:01:54 UTC
python-billiard fails to build with Python 3.9.0a2.

    def spawnv_passfds(path, args, passfds):
        passfds = sorted(passfds)
        errpipe_read, errpipe_write = os.pipe()
        try:
>           return _posixsubprocess.fork_exec(
                args, [fsencode(path)], True, tuple(passfds), None, None,
                -1, -1, -1, -1, -1, -1, errpipe_read, errpipe_write,
                False, False, None)
E               TypeError: fork_exec() takes exactly 21 arguments (17 given)

billiard/compat.py:223: TypeError


Seems like the package is using some private API that was changed.

For the build logs, see:
https://copr-be.cloud.fedoraproject.org/results/@python/python3.9/fedora-rawhide-x86_64/01148768-python-billiard/

For all our attempts to build python-billiard with Python 3.9, see:
https://copr.fedorainfracloud.org/coprs/g/python/python3.9/package/python-billiard/

Testing and mass rebuild of packages is happening in copr. You can follow these instructions to test locally in mock if your package builds with Python 3.9:
https://copr.fedorainfracloud.org/coprs/g/python/python3.9/

Let us know here if you have any questions.

Python 3.9 will be included in Fedora 33. To make that update smoother, we're building Fedora packages with early pre-releases of Python 3.9.
A build failure prevents us from testing all dependent packages (transitive [Build]Requires), so if this package is required a lot, it's important for us to get it fixed soon.
We'd appreciate help from the people who know this package best, but if you don't want to work on this now, let us know so we can try to work around it on our side.

Comment 1 Ben Cotton 2020-02-11 17:34:06 UTC
This bug appears to have been reported against 'rawhide' during the Fedora 32 development cycle.
Changing version to 32.

Comment 2 Miro Hrončok 2020-02-12 14:39:03 UTC
This blocks bodhi.

Comment 3 Miro Hrončok 2020-03-01 21:40:42 UTC
Fabian, could you please prioritize this? We cannot ship Python 3.9 in Fedora if bodhi client isn't working.

Comment 4 Victor Stinner 2020-03-03 15:06:34 UTC
I reported the issue upstream: https://github.com/celery/billiard/issues/309

Comment 5 Miro Hrončok 2020-03-16 18:30:20 UTC
Setting the severity to high.

This package is part of the initial bootstrap sequence. Without it, we cannot proceed with the bootstrap in a Koji side tag.

https://fedoraproject.org/wiki/Changes/Python3.9#Important_dates_and_plan

The current plan is to follow the "ideal point when we can start rebuilding in Koji" -- that is we need to get this bug fixed approximately in 2 months.

That includes potential uncovered bugs in packages that depend on this one.

Please knowledge that you have read this message and that you can dedicate time to fix it. If you know already that you won't be able to fix it by the deadline, please let us know ASAP, so we can allocate resources to do that. Thank You.

(This comment is posted to multiple Bugzillas, please forgive me if it's not 100% accurate.)

Comment 6 Victor Stinner 2020-03-16 20:55:52 UTC
> I reported the issue upstream: https://github.com/celery/billiard/issues/309

I converted my inline patch into a concrete PR: https://github.com/celery/billiard/pull/310

Comment 7 Fabian Affolter 2020-03-17 10:30:18 UTC
The mentioned PR should fix the issue. Package will be updated if upstream merged it and made a new release.

Comment 8 Miro Hrončok 2020-03-17 11:13:22 UTC
I've build the patched billiard in the Copr for now https://copr.fedorainfracloud.org/coprs/g/python/python3.9/build/1309558/

Comment 10 Victor Stinner 2020-05-25 15:29:29 UTC
> I converted my inline patch into a concrete PR: https://github.com/celery/billiard/pull/310

FYI it has been merged.


Note You need to log in before you can comment on or make changes to this bug.