Note: This is a public test instance of Red Hat Bugzilla. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback at bugzilla.redhat.com.
Bug 2024527 - dnf breaks updateprocess with "already downloaded"
Summary: dnf breaks updateprocess with "already downloaded"
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Fedora
Classification: Fedora
Component: dnf
Version: rawhide
Hardware: aarch64
OS: Linux
medium
high
Target Milestone: ---
Assignee: Marek Blaha
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard: AcceptedFreezeException
: 2066048 2070123 (view as bug list)
Depends On:
Blocks: F36FinalFreezeException
TreeView+ depends on / blocked
 
Reported: 2021-11-18 09:18 UTC by customercare
Modified: 2022-04-06 11:24 UTC (History)
16 users (show)

Fixed In Version: dnf-4.11.1-2.fc36 dnf-4.11.1-2.fc35
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 2070966 2070967 (view as bug list)
Environment:
Last Closed: 2022-04-03 00:15:42 UTC
Type: Bug
Embargoed:

Attachments (Terms of Use)
update log with error. (deleted)
2021-11-18 09:18 UTC, customercare 		no flags Details
View All

Description customercare 2021-11-18 09:18:38 UTC 
Created attachment 1842530 [details]
update log with error.

Description of problem:

You will find a log of an broken dnf update process attached. The catch is, the dnf error is "all files are already downloaded" in other words, there is no error message that is presented, it just breaks.

This happened for the second time now in rawhide and needs fixing and a workaround description somewhere, because the normal enduser is not able to fix this, due lack of knowlage.


Version-Release number of selected component (if applicable):

4.10.0-1 FC36


** WORKAROUND **

as root:

dnf clean all; # clean out all already downloaded AND ALL PREVIOUSLY CACHED rpms 
dnf update;    # downloads all new rpms again.


IN CASE OF REQUIRED CACHING, you need to move the rpms out of /var/cache/dnf/<REPONAME..>/packages/  to safe location like /root/ and later copy them back.
Comment 1 customercare 2021-11-22 10:04:06 UTC 
Here is an example for exactly ONE package to update:

[root@fedorapine packages]# dnf update
Fedora - Rawhide - Developmental packages for the next Fedora release                                                                                                                                                                            15 kB/s |  15 kB     00:01    
RPM Fusion for Fedora Rawhide - Free                                                                                                                                                                                                            4.9 kB/s | 4.6 kB     00:00    
Abhängigkeiten sind aufgelöst.
================================================================================================================================================================================================================================================================================
 Package                                                                        Architecture                                          Version                                                        Repository                                                            Size
================================================================================================================================================================================================================================================================================
Aktualisieren:
 gstreamer1-plugins-bad-freeworld                                               aarch64                                               1:1.19.3-1.fc36                                                rpmfusion-free-rawhide                                               182 k

Transaktionsübersicht
================================================================================================================================================================================================================================================================================
Aktualisieren  1 Paket

Gesamtgröße: 182 k
Ist dies in Ordnung? [j/N]: j
Pakete werden heruntergeladen:
[SKIPPED] gstreamer1-plugins-bad-freeworld-1.19.3-1.fc36.aarch64.rpm: Already downloaded                                                                                                                                                                                       

Fehler: Fehler beim Herunterladen der Pakete:
  gstreamer1-plugins-bad-freeworld-1:1.19.3-1.fc36.aarch64: Already downloaded
[root@fedorapine packages]# dnf clean all
297 Dateien entfernt
[root@fedorapine packages]# dnf update
Copr repo for mobile owned by njha                                                                                                                                                                                                              6.6 kB/s |  48 kB     00:07    
Fedora - Rawhide - Developmental packages for the next Fedora release   
1.9 MB/s |  58 MB     00:29    
Fedora - Modular Rawhide - Developmental packages for the next Fedora release                                                                                                                                                                   602 kB/s | 1.0 MB     00:01    
RPM Fusion for Fedora Rawhide - Free                                                                                                                                                                                                            621 kB/s | 879 kB     00:01    
RPM Fusion for Fedora Rawhide - Nonfree                                                                                                                                                                                                         169 kB/s | 138 kB     00:00    
Letzte Prüfung auf abgelaufene Metadaten: vor 0:00:01 am Mo 22 Nov 2021 11:02:17 CET.
Abhängigkeiten sind aufgelöst.
================================================================================================================================================================================================================================================================================
 Package                                                                        Architecture                                          Version                                                        Repository                                                            Size
================================================================================================================================================================================================================================================================================
Aktualisieren:
 gstreamer1-plugins-bad-freeworld                                               aarch64                                               1:1.19.3-1.fc36                                                rpmfusion-free-rawhide                                               182 k

Transaktionsübersicht
================================================================================================================================================================================================================================================================================
Aktualisieren  1 Paket

Gesamte Downloadgröße: 182 k
Ist dies in Ordnung? [j/N]: j
Pakete werden heruntergeladen:
gstreamer1-plugins-bad-freeworld-1.19.3-1.fc36.aarch64.rpm                                                                                                                                                                                      689 kB/s | 182 kB     00:00    A
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Gesamt                                                                                                                                                                                                                                          111 kB/s | 182 kB     00:01     
Transaktionsüberprüfung wird ausgeführt
Transaktionsprüfung war erfolgreich.
Transaktion wird getestet
Transaktionstest war erfolgreich.
Transaktion wird ausgeführt
  Vorbereitung läuft    :                                                                                                                                                                                                                                                   1/1 
  Aktualisieren         : gstreamer1-plugins-bad-freeworld-1:1.19.3-1.fc36.aarch64                                                                                                                                                                                          1/2 
  Aufräumen             : gstreamer1-plugins-bad-freeworld-1:1.19.2-1.fc36.aarch64                                                                                                                                                                                          2/2 
  Ausgeführtes Scriptlet: gstreamer1-plugins-bad-freeworld-1:1.19.2-1.fc36.aarch64                                                                                                                                                                                          2/2 
  Überprüfung läuft     : gstreamer1-plugins-bad-freeworld-1:1.19.3-1.fc36.aarch64                                                                                                                                                                                          1/2 
  Überprüfung läuft     : gstreamer1-plugins-bad-freeworld-1:1.19.2-1.fc36.aarch64                                                                                                                                                                                          2/2 

Aktualisiert:
  gstreamer1-plugins-bad-freeworld-1:1.19.3-1.fc36.aarch64                                                                                                                                                                                                                      

Fertig.


Conclusion: It's nothing with the rpms itself, it's a dnf internal bug.
Comment 2 customercare 2021-11-22 10:05:21 UTC 
I updated all of the rpm via rpm -U manually, just to rule out any package problems: none had issues .
Comment 3 Ben Cotton 2022-02-08 21:27:03 UTC 
This bug appears to have been reported against 'rawhide' during the Fedora 36 development cycle.
Changing version to 36.
Comment 4 customercare 2022-02-27 09:06:32 UTC 
Still happening with :

# rpm -qi dnf
Name        : dnf
Version     : 4.10.0
Release     : 2.fc36
Architecture: noarch
Install Date: Sa 05 Feb 2022 17:53:16 CET

and very annoying.
Comment 5 Mamoru TASAKA 2022-03-14 07:17:59 UTC 
I see this issue also on ja_JP.utf8, zh_ZW.utf8

# rpm -q dnf
dnf-4.10.0-2.fc36.noarch

root@localhost ~]# env LANG=C.utf8 LC_ALL=C.utf8 dnf -y upgrade rubygem-unf_ext --downloadonly
Last metadata expiration check: 0:04:30 ago on Mon Mar 14 15:36:20 2022.
Dependencies resolved.
=====================================================================================================
 Package             Architecture    Version           Repository          Size
=====================================================================================================
Upgrading:
 rubygem-unf_ext     x86_64         0.0.8.1-1.fc36     updates-testing     157 k

Transaction Summary
=====================================================================================================
Upgrade  1 Package

Total download size: 157 k
DNF will only download packages for the transaction.
Downloading Packages:
rubygem-unf_ext-0.0.8.1-1.fc36.x86_64.rpm                                                                                                                                                              914 kB/s | 157 kB     00:00    
-----------------------------------------------------------------------------------------------------
Total                                                                                                                                                                                                  236 kB/s | 157 kB     00:00     
Complete!
The downloaded packages were saved in cache until the next successful transaction.
You can remove cached packages by executing 'dnf clean packages'.
[root@localhost ~]# env LANG=ja_JP.utf8 LC_ALL=ja_JP.utf8 dnf upgrade rubygem-unf_ext
メタデータの期限切れの最終確認: 0:04:45 時間前の 2022年03月14日 15時36分20秒 に実施しました。
依存関係が解決しました。
=====================================================================================================
 パッケージ             アーキテクチャー   バージョン            リポジトリー           サイズ
=====================================================================================================
アップグレード:
 rubygem-unf_ext     x86_64         0.0.8.1-1.fc36     updates-testing     157 k
トランザクションの概要
=====================================================================================================
アップグレード  1 パッケージ

合計サイズ: 157 k
これでよろしいですか? [y/N]: y
パッケージのダウンロード:
[SKIPPED] rubygem-unf_ext-0.0.8.1-1.fc36.x86_64.rpm: Already downloaded                                                                                                                                                               

ダウンロード済みのパッケージは、次の正常なトランザクションまでキャッシュに保存されました。
'dnf clean packages' を実行することでキャッシュパッケージを削除できます。
エラー: パッケージのダウンロード中にエラーが発生しました:
  rubygem-unf_ext-0.0.8.1-1.fc36.x86_64: Already downloaded

[root@localhost ~]# env LANG=zh_TW.utf8 LC_ALL=zh_TW.utf8 dnf upgrade rubygem-unf_ext
Fedora 36 - x86_64 - Test Updates                                                                                                                                                                       15 kB/s |  18 kB     00:01    
依賴關係解析完畢。
=====================================================================================================
 軟體包                架構              版本                  軟體庫                  大小
=====================================================================================================
升級:
 rubygem-unf_ext     x86_64         0.0.8.1-1.fc36     updates-testing     157 k

處理事項摘要
=====================================================================================================
升級  1 軟體包

總大小：157 k
這樣可以嗎 [y/N]： y
下載軟體包：
[SKIPPED] rubygem-unf_ext-0.0.8.1-1.fc36.x86_64.rpm: Already downloaded                                                                                                                                                               

直到有下個成功處理事項為止，下載的軟體包會存在快取中。
您可以透過執行「dnf clean packages」移除軟體包快取。
錯誤：下載軟體包時失敗：
  rubygem-unf_ext-0.0.8.1-1.fc36.x86_64: Already downloaded
[root@localhost ~]# env LANG=en_US.utf8 LC_ALL=en_US.utf8 dnf upgrade rubygem-unf_ext
Fedora 36 - x86_64 - Test Updates                                                                                                                                                                      1.1 kB/s |  18 kB     00:16    
Dependencies resolved.
=====================================================================================================
 Package             Architecture   Version           Repository           Size
=====================================================================================================
Upgrading:
 rubygem-unf_ext     x86_64         0.0.8.1-1.fc36     updates-testing     157 k

Transaction Summary
=====================================================================================================
Upgrade  1 Package

Total size: 157 k
Is this ok [y/N]: y
Downloading Packages:
[SKIPPED] rubygem-unf_ext-0.0.8.1-1.fc36.x86_64.rpm: Already downloaded                                                                                                                                                               
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                        1/1 
  Upgrading        : rubygem-unf_ext-0.0.8.1-1.fc36.x86_64  1/2 
  Cleanup          : rubygem-unf_ext-0.0.8-3.fc36.x86_64    2/2 
  Running scriptlet: rubygem-unf_ext-0.0.8-3.fc36.x86_64    2/2 
  Verifying        : rubygem-unf_ext-0.0.8.1-1.fc36.x86_64  1/2 
  Verifying        : rubygem-unf_ext-0.0.8-3.fc36.x86_64    2/2 

Upgraded:
  rubygem-unf_ext-0.0.8.1-1.fc36.x86_64                                                                                                                                                                                                

Complete!
Comment 6 Mamoru TASAKA 2022-03-14 07:22:12 UTC 
So this fails at least on ja_JP.utf8 , zh_TW.utf8 . Reporter says this also fails on de_DE.utf8 (perhaps?), but this succeeds on C.utf8.
Comment 7 Fedora Blocker Bugs Application 2022-03-14 07:32:13 UTC 
Proposed as a Freeze Exception for 36-final by Fedora user mtasaka using the blocker tracking app because:

 This bug may affect lots of non-English Fedora user when doing software update
Comment 8 Marek Blaha 2022-03-14 08:46:28 UTC 
The problem is real and valid. You are not able to update the system with other than english locale in case that some of the updates were already downloaded. This is quite common when you use dnf-automatic. As mentioned you can work-around this issue by cleaning the dnf cache.

Steps to reproduce:

1. you need to have at least one upgradable package on the system
2. download updates into cache: # dnf update --downloadonly -y
3. try to update the system having other than C locale set: # LC_ALL=de_DE.utf8 dnf update -y

============================================================================================================================================
 Paket                                    Architektur                Version                              Paketquelle                 Größe
============================================================================================================================================
Aktualisieren:
 libuv                                    x86_64                     1:1.44.1-1.fc35                      updates                     150 k

Transaktionszusammenfassung
============================================================================================================================================
Aktualisieren  1 Paket

Gesamtgröße: 150 k
Pakete werden heruntergeladen:
[SKIPPED] libuv-1.44.1-1.fc35.x86_64.rpm: Already downloaded                                                                               

Die heruntergeladenen Pakete wurden bis zur nächsten erfolgreichen Transaktion im Zwischenspeicher abgelegt.
Sie können zwischengespeicherte Pakete mit dem Befehl »dnf clean packages« entfernen.
Fehler: Fehler beim Herunterladen der Pakete:
  libuv-1:1.44.1-1.fc35.x86_64: Already downloaded
Comment 9 Marek Blaha 2022-03-14 09:01:47 UTC 
PR https://github.com/rpm-software-management/dnf/pull/1818 fixes the problem.
Comment 10 customercare 2022-03-17 08:38:19 UTC 
Not about Comment#7:

> Proposed as a Freeze Exception for 36-final by Fedora user mtasaka using the
> blocker tracking app because:


This bug is not listed on F36 Beta Blocker Bugslist:

https://qa.fedoraproject.org/blockerbugs/milestone/36/beta/buglist
Comment 11 Mamoru TASAKA 2022-03-17 14:28:54 UTC 
> Proposed as a Freeze Exception for 36-"final"
Comment 12 Marek Blaha 2022-03-21 07:29:56 UTC 
*** Bug 2066048 has been marked as a duplicate of this bug. ***
Comment 13 Adam Williamson 2022-03-28 14:56:21 UTC 
+4 in https://pagure.io/fedora-qa/blocker-review/issue/660 , marking accepted.
Comment 14 Marek Blaha 2022-03-31 07:36:41 UTC 
*** Bug 2070123 has been marked as a duplicate of this bug. ***
Comment 15 Mamoru TASAKA 2022-03-31 13:36:21 UTC 
Should I backport the upstream fix to Fedora rpms using provenpackager power?
Comment 16 Adam Williamson 2022-03-31 16:03:30 UTC 
I'd rather let the maintainers do it if possible. Marek, can you or someone else from DNF team please get this fix backported to Rawhide and F36? Thanks!
Comment 17 Marek Blaha 2022-04-01 07:25:50 UTC 
Yes, @jrohel is already working on this.
Comment 18 Fedora Update System 2022-04-01 13:41:36 UTC 
FEDORA-2022-35fda65bea has been submitted as an update to Fedora 35. https://bodhi.fedoraproject.org/updates/FEDORA-2022-35fda65bea
Comment 19 Fedora Update System 2022-04-01 13:42:46 UTC 
FEDORA-2022-e8f2dc6c50 has been submitted as an update to Fedora 36. https://bodhi.fedoraproject.org/updates/FEDORA-2022-e8f2dc6c50
Comment 20 Fedora Update System 2022-04-02 01:25:22 UTC 
FEDORA-2022-e8f2dc6c50 has been pushed to the Fedora 36 testing repository.
Soon you'll be able to install the update with the following command:
`sudo dnf upgrade --enablerepo=updates-testing --advisory=FEDORA-2022-e8f2dc6c50`
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2022-e8f2dc6c50

See also https://fedoraproject.org/wiki/QA:Updates_Testing for more information on how to test updates.
Comment 21 Fedora Update System 2022-04-02 02:41:33 UTC 
FEDORA-2022-35fda65bea has been pushed to the Fedora 35 testing repository.
Soon you'll be able to install the update with the following command:
`sudo dnf upgrade --enablerepo=updates-testing --advisory=FEDORA-2022-35fda65bea`
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2022-35fda65bea

See also https://fedoraproject.org/wiki/QA:Updates_Testing for more information on how to test updates.
Comment 22 Jon Richter 2022-04-02 15:51:12 UTC 
Another workaround for people that came here from a search engine, like me, is to fix this temporarily on machines with non-working locales, without losing the package cache, through specifying the locale, in reverse to Marek's example above, as one where the described effect does not occur, e.g.:

  LC_ALL=en_GB.utf8 dnf update -y
Comment 23 Fedora Update System 2022-04-03 00:15:42 UTC 
FEDORA-2022-e8f2dc6c50 has been pushed to the Fedora 36 stable repository.
If problem still persists, please make note of it in this bug report.
Comment 24 Fedora Update System 2022-04-03 02:04:42 UTC 
FEDORA-2022-35fda65bea has been pushed to the Fedora 35 stable repository.
If problem still persists, please make note of it in this bug report.
Comment 25 customercare 2022-04-06 11:24:32 UTC 
Fix confirmed.
Note You need to log in before you can comment on or make changes to this bug.