1577747 – old metadata are not clean-up + slowness

Note: This is a public test instance of Red Hat Bugzilla. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback at bugzilla.redhat.com.

Bug 1577747 - old metadata are not clean-up + slowness

Summary: old metadata are not clean-up + slowness

Keywords:
Status:	CLOSED ERRATA
Alias:	None
Product:	Fedora
Classification:	Fedora
Component:	createrepo_c
Sub Component:
Version:	30
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	unspecified
Target Milestone:	---
Assignee:	amatej
QA Contact:	Fedora Extras Quality Assurance
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2018-05-14 05:48 UTC by Remi Collet
Modified:	2019-09-25 01:07 UTC (History)
CC List:	7 users (show)
Fixed In Version:	createrepo_c-0.15.1-1.fc30
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:	2019-09-25 01:07:34 UTC
Type:	Bug
Embargoed:
Dependent Products:

Attachments	(Terms of Use)

Description Remi Collet 2018-05-14 05:48:37 UTC

Description of problem:
old metadata are not clean-up

Version-Release number of selected component (if applicable):
createrepo_c-0.10.0-15.fc27

How reproducible:
Always

Steps to Reproduce:
1.  createrepo_c --workers 4  \
       --unique-md-filenames  \
       --changelog-limit 3    \
       --compress-type=bz2    \
       --database .
2. ll repodata

Actual results:
tons of files

Expected results:
only last metadata (or some older if --retain-old-md is used)

Additional info:

Comment 1 Remi Collet 2018-05-14 05:57:15 UTC

This issue also make createrepo_c terribly slow

$ time  createrepo_c  --workers 4      \
>                --unique-md-filenames \
>                --retain-old-md 1     \
>                --changelog-limit 3   \
>                --compress-type=bz2   \
>                --database $(pwd)
Directory walk started
Directory walk done - 1886 packages
Temporary output repo path: /home/rpmbuild/site/rpms/fedora/28/remi/x86_64/.repodata/
Preparing sqlite DBs
Pool started (with 4 workers)
Pool finished

real	0m30,673s
user	0m4,050s
sys	0m4,540s

$ rm -rf repodata
$ time  createrepo_c  --workers 4      \
>                --unique-md-filenames \
>                --retain-old-md 1     \
>                --changelog-limit 3   \
>                --compress-type=bz2   \
>                --database $(pwd)
Directory walk started
Directory walk done - 1886 packages
Temporary output repo path: /home/rpmbuild/site/rpms/fedora/28/remi/x86_64/.repodata/
Preparing sqlite DBs
Pool started (with 4 workers)
Pool finished

real	0m2,606s
user	0m3,418s
sys	0m0,311s



So 2" (empty repodata) versus 30" with an existing repodata with tons of old files

Comment 2 Ben Cotton 2018-11-27 14:10:25 UTC

This message is a reminder that Fedora 27 is nearing its end of life.
On 2018-Nov-30  Fedora will stop maintaining and issuing updates for
Fedora 27. It is Fedora's policy to close all bug reports from releases
that are no longer maintained. At that time this bug will be closed as
EOL if it remains open with a Fedora  'version' of '27'.

Package Maintainer: If you wish for this bug to remain open because you
plan to fix it in a currently maintained version, simply change the 'version' 
to a later Fedora version.

Thank you for reporting this issue and we are sorry that we were not 
able to fix it before Fedora 27 is end of life. If you would still like 
to see this bug fixed and are able to reproduce it against a later version 
of Fedora, you are encouraged  change the 'version' to a later Fedora 
version prior this bug is closed as described in the policy above.

Although we aim to fix as many bugs as possible during every release's 
lifetime, sometimes those efforts are overtaken by events. Often a 
more recent Fedora release includes newer upstream software that fixes 
bugs or makes them obsolete.

Comment 3 Ben Cotton 2019-02-19 17:12:22 UTC

This bug appears to have been reported against 'rawhide' during the Fedora 30 development cycle.
Changing version to '30.

Comment 4 amatej 2019-04-04 11:46:55 UTC

I am not able to reproduce this, not even on fedora 27 with the exact same version.
If you still run into this problem, can you try adding "--verbose" parameter to your createrepo_c run?
It could perhaps reveal some additional information about the issue.

Also does this happen for every run you do or just some specific repository?

Comment 5 Remi Collet 2019-04-10 11:20:09 UTC

createrepo_c-0.12.2-1.fc29 is still affected

Reproducer

$ mkdir /tmp/foo
$ cd /tmp/foo
$ cp /path/to/some/*.rpm .
$ for i in *rpm\
  do
    rm -f $i
    createrepo_c --workers 4 --unique-md-filenames --changelog-limit 3 --compress-type=bz2 --retain-old-md 2 --database . &>/dev/null
    ll repodata/*primary.xml* | wc -l;
  done

Output:

1
2
3
4
5
6
7
8
9
10
...

Comment 6 Remi Collet 2019-04-10 11:27:48 UTC

+ createrepo_c --workers 4 --unique-md-filenames --changelog-limit 3 --compress-type=bz2 --retain-old-md 2 --database --verbose .
13:27:21: Version: 0.12.2 (Features: DeltaRPM LegacyWeakdeps )
13:27:21: Signal handler setup
13:27:21: Thread pool ready
Directory walk started
13:27:21: Dir to scan: ./.repodata
13:27:21: Dir to scan: ./repodata
13:27:21: Adding pkg: ./php-pecl-zookeeper-0.7.1-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zookeeper-0.7.0-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zookeeper-0.6.4-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zookeeper-0.6.3-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zookeeper-0.6.2-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zmq-1.1.3-8.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zmq-1.1.3-7.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zmq-1.1.3-6.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zmq-1.1.3-5.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zmq-1.1.3-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zip-1.15.4-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zip-1.15.4-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zip-1.15.3-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zip-1.15.3-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zip-1.15.3-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zendopcache-7.0.5-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zendopcache-7.0.5-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zendopcache-7.0.5-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zendopcache-7.0.4-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-zendopcache-7.0.4-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yp-1.0.1-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yp-1.0.1-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yp-1.0.1-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yp-1.0.1-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yp-1.0.0-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaz-1.2.3-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaz-1.2.2-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaz-1.2.2-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaz-1.2.2-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaz-1.2.2-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yar-2.0.5-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yar-2.0.4-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yar-2.0.4-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yar-2.0.4-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yar-2.0.3-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaml-2.0.4-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaml-2.0.4-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaml-2.0.3-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaml-2.0.2-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaml-2.0.2-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaf-3.0.8-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaf-3.0.7-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaf-3.0.7-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaf-3.0.7-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaf-3.0.7-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaconf-1.0.8-0.3.20180622.d5f267a.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaconf-1.0.8-0.2.20180622.d5f267a.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaconf-1.0.8-0.1.20180622.d5f267a.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaconf-1.0.7-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yaconf-1.0.6-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yac-2.0.2-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yac-2.0.2-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yac-2.0.2-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yac-2.0.2-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-yac-2.0.1-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xxtea-1.0.11-7.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xxtea-1.0.11-6.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xxtea-1.0.11-5.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xxtea-1.0.11-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xxtea-1.0.11-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xslcache-0.7.2-7.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xslcache-0.7.2-6.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xslcache-0.7.2-5.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xslcache-0.7.2-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xslcache-0.7.2-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xrange-1.3.2-7.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xrange-1.3.2-6.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xrange-1.3.2-5.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xrange-1.3.2-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xrange-1.3.2-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xmp-4.2.0-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xmp-4.2.0-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xmp-4.2.0-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xmldiff-1.1.2-9.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xmldiff-1.1.2-13.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xmldiff-1.1.2-12.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xmldiff-1.1.2-11.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xmldiff-1.1.2-10.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xlswriter-1.2.3-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xlswriter-1.2.2-8.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xlswriter-1.2.2-7.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xlswriter-1.2.2-6.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xlswriter-1.2.2-5.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xhprof-0.9.4-8.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xhprof-0.9.4-7.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xhprof-0.9.4-5.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xhprof-0.9.4-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xhprof-0.9.4-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xdiff-2.0.1-5.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xdiff-2.0.1-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xdiff-2.0.1-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xdiff-2.0.1-2.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xdiff-2.0.1-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xdebug-2.7.1-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xdebug-2.7.0~rc2-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xdebug-2.7.0~rc1-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xdebug-2.7.0-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xdebug-2.6.1-1.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xattr-1.3.0-7.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xattr-1.3.0-6.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xattr-1.3.0-5.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xattr-1.3.0-4.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-xattr-1.3.0-3.remi.src.rpm
13:27:21: Adding pkg: ./php-pecl-wxwidgets-3.0.2.0-2.remi.src.rpm
13:27:21: Package count: 104
Directory walk done - 104 packages
Temporary output repo path: ./.repodata/
13:27:21: Creating .xml.gz files
13:27:21: Setting number of packages
Preparing sqlite DBs
13:27:21: Creating databases
13:27:21: Thread pool user data ready
Pool started (with 4 workers)
Pool finished
13:27:21: Generating repomd.xml
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copying files from old repository to the new one
13:27:21: Retention type: 0 (2)
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/9842bc91764dcc689cf58452fe2164c4096bb320dad3e98b5de64a2ba5cee5c0-primary.xml.gz -> ./.repodata/9842bc91764dcc689cf58452fe2164c4096bb320dad3e98b5de64a2ba5cee5c0-primary.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/edf12b1df2bb6ddfb5ba280927c2a5c9e6e942bf504e615800a9fccec334b058-filelists.xml.gz -> ./.repodata/edf12b1df2bb6ddfb5ba280927c2a5c9e6e942bf504e615800a9fccec334b058-filelists.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/9c789618e3b1092ebc5b9e8ed31f5c930c982fed7d41dd66212ec82caa37b4f1-other.xml.gz -> ./.repodata/9c789618e3b1092ebc5b9e8ed31f5c930c982fed7d41dd66212ec82caa37b4f1-other.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/25a62c83cfc3549f9f0adeeaeeced643cbe433c02ccbc83db3dee76870c61227-primary.sqlite.bz2 -> ./.repodata/25a62c83cfc3549f9f0adeeaeeced643cbe433c02ccbc83db3dee76870c61227-primary.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/6ca0a4a604b3c71f2347ed1e88190db9aefe1b48920cbbcb97407d7b0bcf6e51-filelists.sqlite.bz2 -> ./.repodata/6ca0a4a604b3c71f2347ed1e88190db9aefe1b48920cbbcb97407d7b0bcf6e51-filelists.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/938978ac3d6d000ac58170719b09dfbd581483e7ddc48e480d824243d4da76b4-other.sqlite.bz2 -> ./.repodata/938978ac3d6d000ac58170719b09dfbd581483e7ddc48e480d824243d4da76b4-other.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/c7e284a764b46f18dd1aa8bf8df789154b8780ce092731d6ac2ee86142667d4d-primary.xml.gz -> ./.repodata/c7e284a764b46f18dd1aa8bf8df789154b8780ce092731d6ac2ee86142667d4d-primary.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/ad48d6ccc057b24f7550118fdb6f3186509b43af67f6d997aeed8261dc67ea16-filelists.xml.gz -> ./.repodata/ad48d6ccc057b24f7550118fdb6f3186509b43af67f6d997aeed8261dc67ea16-filelists.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/5584bf96a377300586defb9fadd620200ebe914d0ee8f0b74661d53faef77904-other.xml.gz -> ./.repodata/5584bf96a377300586defb9fadd620200ebe914d0ee8f0b74661d53faef77904-other.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/2f279e50aaf934982078414cb2f85e4bcb3c8a597773aad37b7b0dbdd852f6e1-primary.sqlite.bz2 -> ./.repodata/2f279e50aaf934982078414cb2f85e4bcb3c8a597773aad37b7b0dbdd852f6e1-primary.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/b771179bb778e3c4ea0db90eab4cf8c5bc3993c4a599c1f6760c76c1be0e4f36-filelists.sqlite.bz2 -> ./.repodata/b771179bb778e3c4ea0db90eab4cf8c5bc3993c4a599c1f6760c76c1be0e4f36-filelists.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/05b51c8d071051b9a612dcfcabeb8e6b76dc34168e216c3469c2579a1271b237-other.sqlite.bz2 -> ./.repodata/05b51c8d071051b9a612dcfcabeb8e6b76dc34168e216c3469c2579a1271b237-other.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/e071dd7dfab499d2a76a138d13fc81874afd7a0b07b0c5f5ea742370bd1cc42f-primary.xml.gz -> ./.repodata/e071dd7dfab499d2a76a138d13fc81874afd7a0b07b0c5f5ea742370bd1cc42f-primary.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/19f5f5f7c02c7920dd4e476b5da3be0324fbd0b2b675c63be50dafab7d711676-filelists.xml.gz -> ./.repodata/19f5f5f7c02c7920dd4e476b5da3be0324fbd0b2b675c63be50dafab7d711676-filelists.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/3446bb6a02ec79435b25ec4c62276973183bc70cae0efc4b6b47b5b8ce7c9bb1-other.xml.gz -> ./.repodata/3446bb6a02ec79435b25ec4c62276973183bc70cae0efc4b6b47b5b8ce7c9bb1-other.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/aef4e7c3c9e87712d8093e03ae30ef6b29c93a17206510907aa21eeda041a235-primary.sqlite.bz2 -> ./.repodata/aef4e7c3c9e87712d8093e03ae30ef6b29c93a17206510907aa21eeda041a235-primary.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/e6c31cad52da2586ceb057e5cc2465ba98480364c99ef38da371538bb23a28d5-filelists.sqlite.bz2 -> ./.repodata/e6c31cad52da2586ceb057e5cc2465ba98480364c99ef38da371538bb23a28d5-filelists.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/aa393ca39a3ce010a861217bddc8879944886e8d0656eabf63754d94e529c16d-other.sqlite.bz2 -> ./.repodata/aa393ca39a3ce010a861217bddc8879944886e8d0656eabf63754d94e529c16d-other.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/125883128adf26b123f380ddfe6158d2a89ccdbe3377eb066627bc58e4ca4d2c-primary.xml.gz -> ./.repodata/125883128adf26b123f380ddfe6158d2a89ccdbe3377eb066627bc58e4ca4d2c-primary.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/cddd6023b3a8a8afb25170800242383478af9158b6fb1103588b490d8c06468f-filelists.xml.gz -> ./.repodata/cddd6023b3a8a8afb25170800242383478af9158b6fb1103588b490d8c06468f-filelists.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/c9ea9420f398697be139ed00869da817c737c6cca0f57480b2254de23bb5e2c6-other.xml.gz -> ./.repodata/c9ea9420f398697be139ed00869da817c737c6cca0f57480b2254de23bb5e2c6-other.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/f2a1f2231c6a6d88415cb4fc5f099576a7f799657dcfa88deae9beb6d1d89edf-primary.sqlite.bz2 -> ./.repodata/f2a1f2231c6a6d88415cb4fc5f099576a7f799657dcfa88deae9beb6d1d89edf-primary.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/31edb465041b710558d78c16099b760da6606725a1a17f05cc5a9295cb2e99a1-filelists.sqlite.bz2 -> ./.repodata/31edb465041b710558d78c16099b760da6606725a1a17f05cc5a9295cb2e99a1-filelists.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/8698c7862f95a5f5cd5c424308142e5651d030012bc565dc2720ee7f97c66802-other.sqlite.bz2 -> ./.repodata/8698c7862f95a5f5cd5c424308142e5651d030012bc565dc2720ee7f97c66802-other.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/3de8d4739a6d55e91315f9e75708d12dbaa59f7d52c34d2e87dc504e1fe017fb-other.sqlite.bz2 -> ./.repodata/3de8d4739a6d55e91315f9e75708d12dbaa59f7d52c34d2e87dc504e1fe017fb-other.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/0b61b4183349414fad6d54e840fca5d1e4fc61b4e588f00c9638410da3f96c21-filelists.sqlite.bz2 -> ./.repodata/0b61b4183349414fad6d54e840fca5d1e4fc61b4e588f00c9638410da3f96c21-filelists.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/22d18e46b3a422db9a4943a5df185967b29eb8047a5e894fe2b332bb29b572c5-primary.sqlite.bz2 -> ./.repodata/22d18e46b3a422db9a4943a5df185967b29eb8047a5e894fe2b332bb29b572c5-primary.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/d6fc15b9f440712105a09eabfa585d8a86d732469ef3bd5e4d29c3e1a72f337a-other.xml.gz -> ./.repodata/d6fc15b9f440712105a09eabfa585d8a86d732469ef3bd5e4d29c3e1a72f337a-other.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/2d3b252e88d941028f6abc110428826fa017018e14e063d9fc8574d7007c2776-filelists.xml.gz -> ./.repodata/2d3b252e88d941028f6abc110428826fa017018e14e063d9fc8574d7007c2776-filelists.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/f20ba299f7ca5a65bf90975807495ea0d6bdfbcc84b83492db262b64fa0a67a6-primary.xml.gz -> ./.repodata/f20ba299f7ca5a65bf90975807495ea0d6bdfbcc84b83492db262b64fa0a67a6-primary.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/6c4cb71c51b8201c2d9e140c0fe96c8aae39b15ffdd299c8cea8949fcd326293-other.sqlite.bz2 -> ./.repodata/6c4cb71c51b8201c2d9e140c0fe96c8aae39b15ffdd299c8cea8949fcd326293-other.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/ebed365cb3e7505fc96878446b8a2fa52e084801f9bfdc12b69d5b28472f1d89-filelists.sqlite.bz2 -> ./.repodata/ebed365cb3e7505fc96878446b8a2fa52e084801f9bfdc12b69d5b28472f1d89-filelists.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/f45be9363cc7ef8dac66daab5c04b22182cdb628a5f5598dc113c73e9e8fdf98-primary.sqlite.bz2 -> ./.repodata/f45be9363cc7ef8dac66daab5c04b22182cdb628a5f5598dc113c73e9e8fdf98-primary.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/24da6cf57589482e71a34aa04ed615ceb044f22175c9fe244e1b64ec3e8f1722-other.xml.gz -> ./.repodata/24da6cf57589482e71a34aa04ed615ceb044f22175c9fe244e1b64ec3e8f1722-other.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/64e312a743baffbfb353b15a77c9cd36f69d397dcf846bf542da213614ac3bf2-filelists.xml.gz -> ./.repodata/64e312a743baffbfb353b15a77c9cd36f69d397dcf846bf542da213614ac3bf2-filelists.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/6136d0afe35adbe1094e6e47be2bdbd4d2520d08d2a3ecb1271ecd4911a05fb9-primary.xml.gz -> ./.repodata/6136d0afe35adbe1094e6e47be2bdbd4d2520d08d2a3ecb1271ecd4911a05fb9-primary.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/fa0983ef6377d8feb2ff430180c6375780c84c97b600601676184ad48453c5a0-other.sqlite.bz2 -> ./.repodata/fa0983ef6377d8feb2ff430180c6375780c84c97b600601676184ad48453c5a0-other.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/599500a3e157f0fe6d9b42917b629e86c9ed82209811fb2edcf596f42100ec93-filelists.sqlite.bz2 -> ./.repodata/599500a3e157f0fe6d9b42917b629e86c9ed82209811fb2edcf596f42100ec93-filelists.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/35ed5cd3b4ba154dc6c7d10417f3add34c9f476a2e82283eb1000f17d1a0a379-primary.sqlite.bz2 -> ./.repodata/35ed5cd3b4ba154dc6c7d10417f3add34c9f476a2e82283eb1000f17d1a0a379-primary.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/494ac9fdd3ef59cbbb895940ee36fbe7e648ddef17ec314f28b0d209f01d1f81-other.xml.gz -> ./.repodata/494ac9fdd3ef59cbbb895940ee36fbe7e648ddef17ec314f28b0d209f01d1f81-other.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/9379bee27da62591e6b266168203e3e3f94f17dd45568ce2ee25c262209dd3a7-filelists.xml.gz -> ./.repodata/9379bee27da62591e6b266168203e3e3f94f17dd45568ce2ee25c262209dd3a7-filelists.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/aaf983cb0abe02a490830d5d7e7616f7fb2e6ff158dc10fc6edc01c6cfdea582-primary.xml.gz -> ./.repodata/aaf983cb0abe02a490830d5d7e7616f7fb2e6ff158dc10fc6edc01c6cfdea582-primary.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/c188a5c404eee59e6fa1eee4b8ee8936400b62311535cd84c63fa84d14a02c62-other.sqlite.bz2 -> ./.repodata/c188a5c404eee59e6fa1eee4b8ee8936400b62311535cd84c63fa84d14a02c62-other.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/2000abe35293cfb459edc20bafb0290cd1ac1af05e3fd0eef227982204aef12f-filelists.sqlite.bz2 -> ./.repodata/2000abe35293cfb459edc20bafb0290cd1ac1af05e3fd0eef227982204aef12f-filelists.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/3c8a22fbf78d170a63036cc7f31d1654e770dc7d4ca4bb753d00bd01a53e943f-primary.sqlite.bz2 -> ./.repodata/3c8a22fbf78d170a63036cc7f31d1654e770dc7d4ca4bb753d00bd01a53e943f-primary.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/9927745d42350f14b2bde34091df581088188498664022ddddb7e7ad9de3450c-other.xml.gz -> ./.repodata/9927745d42350f14b2bde34091df581088188498664022ddddb7e7ad9de3450c-other.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/47d7f8deb788578c658ae8f40b8ccd70b9dfea36b355b45c0833371cdec43a86-filelists.xml.gz -> ./.repodata/47d7f8deb788578c658ae8f40b8ccd70b9dfea36b355b45c0833371cdec43a86-filelists.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/9e6520190f30056e46cd7d5fc20040df75dc34be182790b37215801c15aa3a89-primary.xml.gz -> ./.repodata/9e6520190f30056e46cd7d5fc20040df75dc34be182790b37215801c15aa3a89-primary.xml.gz
13:27:21: Blacklisted: repomd.xml
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/ef742506fea2d7e27dd6ede974bbd037914d18bcb59998e0906539f002fa38f5-other.sqlite.bz2 -> ./.repodata/ef742506fea2d7e27dd6ede974bbd037914d18bcb59998e0906539f002fa38f5-other.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/5b4ecb90f33c0c31972804ae9c9416fd976aab8a5c3826a699cf047c19f04e00-filelists.sqlite.bz2 -> ./.repodata/5b4ecb90f33c0c31972804ae9c9416fd976aab8a5c3826a699cf047c19f04e00-filelists.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/4e801600bc92c929cec924f3605da63175de74e577a799d6f974edb35e0b3927-primary.sqlite.bz2 -> ./.repodata/4e801600bc92c929cec924f3605da63175de74e577a799d6f974edb35e0b3927-primary.sqlite.bz2
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/1820cf375fb7eab13b0de9d43cb1a724a0a6d7fa19939d0d0206336d57a9faeb-other.xml.gz -> ./.repodata/1820cf375fb7eab13b0de9d43cb1a724a0a6d7fa19939d0d0206336d57a9faeb-other.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/8f30979f14a0b63f85961a5b3c4781e58a53bea8805c9931a9fab50e66d86fac-filelists.xml.gz -> ./.repodata/8f30979f14a0b63f85961a5b3c4781e58a53bea8805c9931a9fab50e66d86fac-filelists.xml.gz
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Copied ./repodata/7476483dde3dd8032415ca9ee345217f8c739be8b4b2c6452a715333b9f0b8f8-primary.xml.gz -> ./.repodata/7476483dde3dd8032415ca9ee345217f8c739be8b4b2c6452a715333b9f0b8f8-primary.xml.gz
13:27:21: Renamed ./repodata/ -> ./repodata.old.32504.20190410132721.151027
13:27:21: Renamed ./.repodata/ -> ./repodata/
13:27:21: posix_spawn avoided (fd close requested) 
13:27:21: Old repo ./repodata.old.32504.20190410132721.151027 removed
13:27:21: Memory cleanup
13:27:21: All done

Comment 7 amatej 2019-07-12 11:42:17 UTC

Sorry for the delay I got a sidetracked. 

Thank you for the reproducer. I think I figured out the problem, its the --retain-old-md option without it you always have only one set of repodata.

Upon closer inspection I found the --retain-old-md is wrongly documented. I created a PR (https://github.com/rpm-software-management/createrepo_c/pull/171) that among other things fixes this and explains how the --retain-old-md option really works.

Comment 8 Fedora Update System 2019-09-18 11:36:23 UTC

FEDORA-2019-0c7c99d987 has been submitted as an update to Fedora 30. https://bodhi.fedoraproject.org/updates/FEDORA-2019-0c7c99d987

Comment 9 Fedora Update System 2019-09-19 02:20:31 UTC

createrepo_c-0.15.1-1.fc30, drpm-0.4.1-1.fc30 has been pushed to the Fedora 30 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2019-0c7c99d987

Comment 10 Fedora Update System 2019-09-25 01:07:34 UTC

createrepo_c-0.15.1-1.fc30, drpm-0.4.1-1.fc30 has been pushed to the Fedora 30 stable repository. If problems still persist, please make note of it in this bug report.

Note You need to log in before you can comment on or make changes to this bug.