This seem to be realated to the removal of the old parser: https://bugs.python.org/issue40939

This bug appears to have been reported against 'rawhide' during the Fedora 34 development cycle.
Changing version to 34.

This is a mass-posted update. Sorry if it is not 100% accurate to this bugzilla.


The Python 3.10 rebuild is in progress in a Koji side tag. If you manage to fix the problem, please commit the fix in the rawhide branch, but don't build the package in regular rawhide.

You can either build the package in the side tag, with:

    $ fedpkg build --target=f35-python

Or you can the build and we will eventually build it for you.

Note that the rebuild is still in progress, so not all (build) dependencies of this package might be available right away.

Thanks.

See also https://fedoraproject.org/wiki/Changes/Python3.10

If you have general questions about the rebuild, please use this mailing list thread: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org/thread/G47SGOYIQLRDTWGOSLSWERZSSHXDEDH5/

The f35-python side tag has been merged to Rawhide. From now on, build as you would normally build.

I see there is no upstream response. How can we (the Python Maintainers) help you here?

(In reply to Miro Hrončok from comment #5)
> I see there is no upstream response. How can we (the Python Maintainers)
> help you here?

Write a patch? I don't really know how much work it will be to support Python 3.10 in kdevelop-python, but I have zero knowlege in this area and won't be able to implement it myself. It's unfortunate we block you, but I don't know what to do about this besides waiting for upstream to fix it.

As much as we would like help as many package maintainers as possible, unfortunately we don't have the capacity to write hundreds of patches. I'll have a look at the code and see what it is trying to accomplish, possibly drafting a solution.

For reference:

Python 3.9 support: https://invent.kde.org/kdevelop/kdev-python/-/commit/05e95cac74b0bb3595a6d97da07a12b907385be5
Python 3.8 support: https://invent.kde.org/kdevelop/kdev-python/-/commit/e23fa8f15af89a8bd4bd84dd96b5fd7017457516

For reference. The following includes need to be removed from parser/python_header.h:

-#include "node.h"
-#include "Python-ast.h"
-#include "ast.h"
-#include "graminit.h"
-#include "grammar.h"
-#include "parsetok.h"


In parser/astbuilder.cpp PyParser_ASTFromString() needs to be replaced with Import_ImportModule("ast"), PyObject_CallMethod(..., "parse" ...).


I won't be able to finish this this week, but I'll talk to Victor Stinner and Petr Viktorin next week about documenting an upgrade path in https://docs.python.org/3.10/whatsnew/3.10.html#changes-in-the-c-api

Dear Maintainer,

your package has an open Fails To Build From Source bug for Fedora 35.
Action is required from you.

If you can fix your package to build, perform a build in koji, and either create
an update in bodhi, or close this bug without creating an update, if updating is
not appropriate [1]. If you are working on a fix, set the status to ASSIGNED to
acknowledge this. If you have already fixed this issue, please close this Bugzilla report.

Following the policy for such packages [2], your package will be orphaned if
this bug remains in NEW state more than 8 weeks (not sooner than 2021-01-11).

A week before the mass branching of Fedora 36 according to the schedule [3],
any packages not successfully rebuilt at least on Fedora 34 will be
retired regardless of the status of this bug.

[1] https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/
[2] https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/
[3] https://fedorapeople.org/groups/schedule/f-36/f-36-key-tasks.html

This bug appears to have been reported against 'rawhide' during the Fedora 35 development cycle.
Changing version to 35.

The parser API has been removed from the public C API. Many functions were renamed and "hidden" in the internal C API. For example, PyParser_ASTFromString() was renamed to _PyParser_ASTFromString() and moved to the pycore_parser.h internal C API. Same for PyArena_New() which was renamed to _PyArena_New().

kdev-python might get to retrieve most functions from the internal C API, but this is fragile. It was moved to the internal C API since this API changes often at each Python release, especially the exact AST tree. Each Python version adds new AST types, removes some AST types, and changes how expressions are stored in AST.

Another approach would be to use a completely different parser which would give a more reliable output.

Dear Maintainer,

your package has an open Fails To Build From Source bug for Fedora 35.
Action is required from you.

If you can fix your package to build, perform a build in koji, and either create
an update in bodhi, or close this bug without creating an update, if updating is
not appropriate [1]. If you are working on a fix, set the status to ASSIGNED to
acknowledge this. If you have already fixed this issue, please close this Bugzilla report.

Following the policy for such packages [2], your package will be orphaned if
this bug remains in NEW state more than 8 weeks (not sooner than 2021-01-11).

A week before the mass branching of Fedora 36 according to the schedule [3],
any packages not successfully rebuilt at least on Fedora 34 will be
retired regardless of the status of this bug.

[1] https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/
[2] https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/
[3] https://fedorapeople.org/groups/schedule/f-36/f-36-key-tasks.html

Upstream kdev-python maintainer here.

I intend to add Python 3.10 support before the next kdev-python feature release, which should be in time for your purposes.

Every CPython release requires changes to kdev-python (Jan Grulich has linked to the last two cycles) so this is unsurprising.

We have always left supporting the next Python version until quite late in its release cycle, because the AST API is indeed prone to breaking changes even in late betas. We have a handy code-generation system that in most cases lets us adapt to AST changes quite easily.

This time there will be the added inconvenience of working around the API "hiding" that Victor Stinner mentioned. I wish I'd seen that issue earlier so I could request CPython upstream *not* do that and make our lives more difficult, but from previous experience they don't care at all about our use case anyway.

At some point it may be easier to maintain a downstream fork of the parser than work around the roadblocks that upstream likes to create, but honestly I don't have the motivation for that.

Dear Maintainer,

your package has an open Fails To Build From Source bug for Fedora 35.
Action is required from you.

If you can fix your package to build, perform a build in koji, and either create
an update in bodhi, or close this bug without creating an update, if updating is
not appropriate [1]. If you are working on a fix, set the status to ASSIGNED to
acknowledge this. If you have already fixed this issue, please close this Bugzilla report.

Following the policy for such packages [2], your package will be orphaned if
this bug remains in NEW state more than 8 weeks (not sooner than 2021-01-11).

A week before the mass branching of Fedora 36 according to the schedule [3],
any packages not successfully rebuilt at least on Fedora 34 will be
retired regardless of the status of this bug.

[1] https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/
[2] https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/
[3] https://fedorapeople.org/groups/schedule/f-36/f-36-key-tasks.html

Francis Herne: "This time there will be the added inconvenience of working around the API "hiding" that Victor Stinner mentioned. I wish I'd seen that issue earlier so I could request CPython upstream *not* do that and make our lives more difficult, but from previous experience they don't care at all about our use case anyway."

The C API still exists, but it has been moved to the internal C API which you are "not supposed to use". In practice, if you use it, it can break any time, there is even less backward compatibility warranties than on the private C API (names prefixed by "_Py"). The private C API has no backward compatibility warranty neither ;-)

The C API changes are related to a lot of compiler and AST changes introduced by the PEG parser:
https://www.python.org/dev/peps/pep-0617/

This issue is not a good place to raise awareness about your use case, you can open an issue at bugs.python.org or send an email to python-dev.

I don't know the ecosystem of parsers in Python projects. I don't know how black or pylint handle the new Python 3.10 grammar which now requires a parser more complicated than a LL(1) parser. By the way, the lib2to3 module is now deprecated in Python 3.11. I saw that black now uses a fork of this project and the fork supports Python 3.10 grammar, if I understood correctly.

This package has been orphaned, according to point 5 of https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/

If you wish to take over, you can pick it up at https://src.fedoraproject.org/rpms/kdevelop-python by clicking the "Take" button. If nobody picks it up, it will be retired and removed from the distribution in 6 weeks.

The final freeze for F35 starts in less than a week on Tuesday 2021-10-05. Setting severity to urgent.

Dear Maintainer,

your package has an open Fails To Build From Source bug for Fedora 35.
Action is required from you.

If you can fix your package to build, perform a build in koji, and either create
an update in bodhi, or close this bug without creating an update, if updating is
not appropriate [1]. If you are working on a fix, set the status to ASSIGNED to
acknowledge this. If you have already fixed this issue, please close this Bugzilla report.

Following the policy for such packages [2], your package will be orphaned if
this bug remains in NEW state more than 8 weeks (not sooner than 2021-01-11).

A week before the mass branching of Fedora 36 according to the schedule [3],
any packages not successfully rebuilt at least on Fedora 34 will be
retired regardless of the status of this bug.

[1] https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/
[2] https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/
[3] https://fedorapeople.org/groups/schedule/f-36/f-36-key-tasks.html

> I intend to add Python 3.10 support before the next kdev-python feature release, which should be in time for your purposes.

Francis, is this still doable in time?

Dear Maintainer,

your package has an open Fails To Build From Source bug for Fedora 35.
Action is required from you.

If you can fix your package to build, perform a build in koji, and either create
an update in bodhi, or close this bug without creating an update, if updating is
not appropriate [1]. If you are working on a fix, set the status to ASSIGNED to
acknowledge this. If you have already fixed this issue, please close this Bugzilla report.

Following the policy for such packages [2], your package will be orphaned if
this bug remains in NEW state more than 8 weeks (not sooner than 2021-01-11).

A week before the mass branching of Fedora 36 according to the schedule [3],
any packages not successfully rebuilt at least on Fedora 34 will be
retired regardless of the status of this bug.

[1] https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/
[2] https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/
[3] https://fedorapeople.org/groups/schedule/f-36/f-36-key-tasks.html

Dear Maintainer,

your package has an open Fails To Build From Source bug for Fedora 35.
Action is required from you.

If you can fix your package to build, perform a build in koji, and either create
an update in bodhi, or close this bug without creating an update, if updating is
not appropriate [1]. If you are working on a fix, set the status to ASSIGNED to
acknowledge this. If you have already fixed this issue, please close this Bugzilla report.

Following the policy for such packages [2], your package will be orphaned if
this bug remains in NEW state more than 8 weeks (not sooner than 2021-01-11).

A week before the mass branching of Fedora 36 according to the schedule [3],
any packages not successfully rebuilt at least on Fedora 34 will be
retired regardless of the status of this bug.

[1] https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/
[2] https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/
[3] https://fedorapeople.org/groups/schedule/f-36/f-36-key-tasks.html

Dear Maintainer,

your package has an open Fails To Build From Source bug for Fedora 36.
Action is required from you.

If you can fix your package to build, perform a build in koji, and either create
an update in bodhi, or close this bug without creating an update, if updating is
not appropriate [1]. If you are working on a fix, set the status to ASSIGNED to
acknowledge this. If you have already fixed this issue, please close this Bugzilla report.

Following the policy for such packages [2], your package will be orphaned if
this bug remains in NEW state more than 8 weeks (not sooner than 2021-01-11).

A week before the mass branching of Fedora 37 according to the schedule [3],
any packages not successfully rebuilt at least on Fedora 35 will be
retired regardless of the status of this bug.

[1] https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/
[2] https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/
[3] https://fedorapeople.org/groups/schedule/f-37/f-37-key-tasks.html

Actually, it's fairly easy to make kdevelop-python build against the python3.9 package instead of python3-devel. The end result works just fine with stock Fedora kdevelop (I've been using it extensively for several months now on multiple machines).

https://copr.fedorainfracloud.org/coprs/tootea/earlybird/package/kdevelop-python/
https://copr-dist-git.fedorainfracloud.org/cgit/tootea/earlybird/kdevelop-python.git/tree/?h=f36

Any chance we could get it back into Fedora this way? I guess we would only need a FESCo exception from the following rule:

> Fedora packages MUST NOT depend on other versions of the CPython interpreter than the current python3.
https://docs.fedoraproject.org/en-US/packaging-guidelines/Python/#_python_version_support

Is this feasible? Would a new review be necessary to un-orphan and revive the package?

An FPC exception would be needed.

And yes, a new review as well.

This message is a reminder that Fedora Linux 35 is nearing its end of life.
Fedora will stop maintaining and issuing updates for Fedora Linux 35 on 2022-12-13.
It is Fedora's policy to close all bug reports from releases that are no longer
maintained. At that time this bug will be closed as EOL if it remains open with a
'version' of '35'.

Package Maintainer: If you wish for this bug to remain open because you
plan to fix it in a currently maintained version, change the 'version' 
to a later Fedora Linux version.

Thank you for reporting this issue and we are sorry that we were not 
able to fix it before Fedora Linux 35 is end of life. If you would still like 
to see this bug fixed and are able to reproduce it against a later version 
of Fedora Linux, you are encouraged to change the 'version' to a later version
prior to this bug being closed.

Fedora Linux 35 entered end-of-life (EOL) status on 2022-12-13.

Fedora Linux 35 is no longer maintained, which means that it
will not receive any further security or bug fix updates. As a result we
are closing this bug.

If you can reproduce this bug against a currently maintained version of Fedora Linux
please feel free to reopen this bug against that version. Note that the version
field may be hidden. Click the "Show advanced fields" button if you do not see
the version field.

If you are unable to reopen this bug, please file a new report against an
active release.

Thank you for reporting this bug and we are sorry it could not be fixed.

The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days