Bug 2246802

Created attachment 1996076 [details]
Update to 1.9.0 (#2246802)

the-new-hotness/release-monitoring.org's scratch build of python-fastavro-1.9.0-1.fc38.src.rpm for rawhide failed http://koji.fedoraproject.org/koji/taskinfo?taskID=108258517

Needs `cramjam`, thin Python bindings to de/compression algorithms in Rust, https://pypi.org/project/cramjam/

Not available in Fedora, yet.

I had a look at cramjam[1] and discussed it in the “Fedora Rust” Matrix room.

The core of it is a Rust crate that has been published on crates.io as “cramjam”[2], but is not kept up to date there anymore. It corresponds to the “libcramjam” directory[3] in the upstream GitHub project. It is in the same workspace with the Python extension[4] and a “cramjam-cli”[5] that is written purely in Rust but published on PyPi[6] so it can be installed via pip. We can ignore the CLI for now. The Python extension (and CLI) reference the crate by path[7], which is normally not OK but is acceptable when the code is in the same workspace. Furthermore, regarding the crate and the out-of-date version on crates.io, Fabio Valentini wrote that “there is no need to package separately if the library isn’t used for anything else.”

So we should just package a python-cramjam package, broadly similar to python-orjson, with a virtual Provides for bundled “crate(shell-escape)”. No rust-cramjam.

Now, on to dependencies. It asks for old versions of the zstd and pyo3 crates, and these bounds will need to be loosened so we can use current versions. Hopefully that’s straightforward. Also, the crates brotli2, lz4, numpy, and snap will need to be packaged (or unretired and updated in the case of brotli2) as rust-brotli2, rust-lz4, rust-numpy, and rust-snap, respectively, along with any dependencies they might have.

I started looking at packaging rust-lz4 and found that rust-lz4-sys needs to be patched[8] to support a system (shared library) copy of liblz4. Even following the example of bzip2-sys[9][10], that was more than I was prepared to tackle at the time, and I put the project on the back burner. I still think it’s all possible with sufficient effort.

[1] https://pypi.org/project/cramjam
[2] https://crates.io/crates/cramjam
[3] https://github.com/milesgranger/pyrus-cramjam/tree/master/libcramjam
[4] https://github.com/milesgranger/pyrus-cramjam/tree/master/cramjam-python
[5] https://github.com/milesgranger/pyrus-cramjam/tree/master/cramjam-cli
[6] https://pypi.org/project/cramjam-cli/
[7] https://github.com/milesgranger/pyrus-cramjam/blob/0bea714eaa814a3c26fd0e3ab15745c690518ac8/cramjam-python/Cargo.toml#L23
[8] https://github.com/10XGenomics/lz4-rs/issues/36
[9] https://github.com/alexcrichton/bzip2-rs/pull/58
[10] https://github.com/alexcrichton/bzip2-rs/pull/78

(In reply to Ben Beasley from comment #4)
> Also, the crates brotli2, lz4,
> numpy, and snap will need to be packaged (or unretired and updated in the
> case of brotli2) as rust-brotli2, rust-lz4, rust-numpy, and rust-snap,
> respectively, along with any dependencies they might have.

Actually, I think this will only need rust-brotli, which is already packaged, not rust-brotli2. I’m also not sure where I picked up rust-numpy as a requirement; it might not be needed either.

Releases retrieved: 1.9.1
Upstream release that is considered latest: 1.9.1
Current version/release in rawhide: 1.8.4-3.fc40
URL: https://github.com/fastavro/fastavro

Please consult the package updates policy before you issue an update to a stable branch: https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/


More information about the service that created this bug can be found at: https://docs.fedoraproject.org/en-US/package-maintainers/Upstream_Release_Monitoring


Please keep in mind that with any upstream change, there may also be packaging changes that need to be made. Specifically, please remember that it is your responsibility to review the new version to ensure that the licensing is still correct and that no non-free or legally problematic items have been added upstream.


Based on the information from Anitya: https://release-monitoring.org/project/16842/


To change the monitoring settings for the project, please visit:
https://src.fedoraproject.org/rpms/python-fastavro

Created attachment 2003291 [details]
Update to 1.9.1 (#2246802)

the-new-hotness/release-monitoring.org's scratch build of python-fastavro-1.9.1-1.fc38.src.rpm for rawhide failed http://koji.fedoraproject.org/koji/taskinfo?taskID=110039568

Releases retrieved: 1.9.2
Upstream release that is considered latest: 1.9.2
Current version/release in rawhide: 1.8.4-3.fc40
URL: https://github.com/fastavro/fastavro

Please consult the package updates policy before you issue an update to a stable branch: https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/


More information about the service that created this bug can be found at: https://docs.fedoraproject.org/en-US/package-maintainers/Upstream_Release_Monitoring


Please keep in mind that with any upstream change, there may also be packaging changes that need to be made. Specifically, please remember that it is your responsibility to review the new version to ensure that the licensing is still correct and that no non-free or legally problematic items have been added upstream.


Based on the information from Anitya: https://release-monitoring.org/project/16842/


To change the monitoring settings for the project, please visit:
https://src.fedoraproject.org/rpms/python-fastavro

Created attachment 2005331 [details]
Update to 1.9.2 (#2246802)

the-new-hotness/release-monitoring.org's scratch build of python-fastavro-1.9.2-1.fc38.src.rpm for rawhide failed http://koji.fedoraproject.org/koji/taskinfo?taskID=110668707

Releases retrieved: 1.9.3
Upstream release that is considered latest: 1.9.3
Current version/release in rawhide: 1.8.4-5.fc40
URL: https://github.com/fastavro/fastavro

Please consult the package updates policy before you issue an update to a stable branch: https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/


More information about the service that created this bug can be found at: https://docs.fedoraproject.org/en-US/package-maintainers/Upstream_Release_Monitoring


Please keep in mind that with any upstream change, there may also be packaging changes that need to be made. Specifically, please remember that it is your responsibility to review the new version to ensure that the licensing is still correct and that no non-free or legally problematic items have been added upstream.


Based on the information from Anitya: https://release-monitoring.org/project/16842/


To change the monitoring settings for the project, please visit:
https://src.fedoraproject.org/rpms/python-fastavro

Created attachment 2007866 [details]
Update to 1.9.3 (#2246802)

the-new-hotness/release-monitoring.org's scratch build of python-fastavro-1.9.3-1.fc38.src.rpm for rawhide failed http://koji.fedoraproject.org/koji/taskinfo?taskID=111505977

Releases retrieved: 1.9.4
Upstream release that is considered latest: 1.9.4
Current version/release in rawhide: 1.8.4-7.fc40
URL: https://github.com/fastavro/fastavro

Please consult the package updates policy before you issue an update to a stable branch: https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/


More information about the service that created this bug can be found at: https://docs.fedoraproject.org/en-US/package-maintainers/Upstream_Release_Monitoring


Please keep in mind that with any upstream change, there may also be packaging changes that need to be made. Specifically, please remember that it is your responsibility to review the new version to ensure that the licensing is still correct and that no non-free or legally problematic items have been added upstream.


Based on the information from Anitya: https://release-monitoring.org/project/16842/


To change the monitoring settings for the project, please visit:
https://src.fedoraproject.org/rpms/python-fastavro

Scratch build failed. Details below:

BuilderException: Build failed:
Command '['rpmbuild', '-D', '_sourcedir .', '-D', '_topdir .', '-bs', '/var/tmp/thn-gskb8vqs/python-fastavro.spec']' returned non-zero exit status 1.

StdOut:
setting SOURCE_DATE_EPOCH=1707782400
error: Bad file: ./fastavro-1.9.4.tar.gz: No such file or directory

RPM build errors:
    Bad file: ./fastavro-1.9.4.tar.gz: No such file or directory


Traceback:
  File "/usr/local/lib/python3.11/site-packages/hotness/use_cases/package_scratch_build_use_case.py", line 56, in build
    result = self.builder.build(request.package, request.opts)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/hotness/builders/koji.py", line 229, in build
    raise BuilderException(

If you think this issue is caused by some bug in the-new-hotness, please report it on the-new-hotness issue tracker: https://github.com/fedora-infra/the-new-hotness/issues

Created attachment 2016631 [details]
Update to 1.9.4 (#2246802)

FEDORA-2024-6cca6fb603 (python-cramjam-2.8.1-1.fc39 and python-fastavro-1.9.4-1.fc39) has been submitted as an update to Fedora 39.
https://bodhi.fedoraproject.org/updates/FEDORA-2024-6cca6fb603

FEDORA-2024-7c670ce3a9 (python-cramjam-2.8.1-1.fc38 and python-fastavro-1.9.4-1.fc38) has been submitted as an update to Fedora 38.
https://bodhi.fedoraproject.org/updates/FEDORA-2024-7c670ce3a9

FEDORA-2024-6cca6fb603 has been pushed to the Fedora 39 testing repository.
Soon you'll be able to install the update with the following command:
`sudo dnf upgrade --enablerepo=updates-testing --refresh --advisory=FEDORA-2024-6cca6fb603`
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2024-6cca6fb603

See also https://fedoraproject.org/wiki/QA:Updates_Testing for more information on how to test updates.

FEDORA-2024-7c670ce3a9 has been pushed to the Fedora 38 testing repository.
Soon you'll be able to install the update with the following command:
`sudo dnf upgrade --enablerepo=updates-testing --refresh --advisory=FEDORA-2024-7c670ce3a9`
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2024-7c670ce3a9

See also https://fedoraproject.org/wiki/QA:Updates_Testing for more information on how to test updates.

FEDORA-2024-6cca6fb603 (python-cramjam-2.8.1-1.fc39 and python-fastavro-1.9.4-1.fc39) has been pushed to the Fedora 39 stable repository.
If problem still persists, please make note of it in this bug report.

FEDORA-2024-7c670ce3a9 (python-cramjam-2.8.1-1.fc38 and python-fastavro-1.9.4-1.fc38) has been pushed to the Fedora 38 stable repository.
If problem still persists, please make note of it in this bug report.