Note: This is a public test instance of Red Hat Bugzilla. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback at bugzilla.redhat.com.
Bug 1564497 - zanata pull is adding bogus "fuzzy" annotations to po files when multiple languages are pulled
Summary: zanata pull is adding bogus "fuzzy" annotations to po files when multiple lan...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Fedora
Classification: Fedora
Component: zanata-python-client
Version: 27
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
Assignee: Sundeep Anand
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-04-06 13:02 UTC by Daniel Berrangé
Modified: 2018-04-27 04:04 UTC (History)
9 users (show)

Fixed In Version: zanata-python-client-1.5.2-1.fc27 zanata-python-client-1.5.2-1.fc28
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2018-04-25 17:59:23 UTC
Type: Bug
Embargoed:

Attachments (Terms of Use)
Fix fuzzy handling (2.06 KB, patch)
2018-04-06 13:02 UTC, Daniel Berrangé 		no flags Details | Diff
View All

Description Daniel Berrangé 2018-04-06 13:02:53 UTC 
Created attachment 1418126 [details]
Fix fuzzy handling

Description of problem:

When running 'zanata pull' to update all the .po files for a project at once, a huge number of incorrect "fuzzy" annotations are being added to the generated .po files.

If you run "zanata pull --lang $LANG" for a single language at a time, the generated .po file is correct, with no bogus "fuzzy" annotations.

Essentially when "zanata pull" processes multiple languages, the "fuzzy" annotations for each language are accumulated into all subsequent languages. So the first language downloaded is correct, the second language has all the fuzzy annotations of the first language mistakenly added. The last language downloaded has all the fuzzy annotations of every single previous language.

When .po file are used to generate the binary .gmo files, all msgids marked fuzzy will be discarded.

So the net effect of this bug is that potentially huge numbers of translations are being lost.

In the libvirt project, we've identified 16,000 translations incorrectly marked as fuzzy.

Any project that's currently using the zanata client will need to re-download their translations either:

1) using zanata client after applying the patch on this bug
2) using unpatched zanata client, with "--lang $LANG" to download one language at time only, in a loop
3) using the zanata-cli Java client

Version-Release number of selected component (if applicable):
zanata-python-client-1.5.1-3.fc27.noarch

How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 1 Daniel Berrangé 2018-04-06 13:08:29 UTC 
Patch proposed upstream in:

https://github.com/zanata/zanata-python-client/pull/51
Comment 2 Fedora Update System 2018-04-16 12:44:41 UTC 
zanata-python-client-1.5.2-1.fc28 has been submitted as an update to Fedora 28. https://bodhi.fedoraproject.org/updates/FEDORA-2018-ee25309139
Comment 3 Fedora Update System 2018-04-16 12:51:19 UTC 
zanata-python-client-1.5.2-1.fc27 has been submitted as an update to Fedora 27. https://bodhi.fedoraproject.org/updates/FEDORA-2018-c5ad60747e
Comment 4 Fedora Update System 2018-04-16 12:58:40 UTC 
zanata-python-client-1.5.2-1.el7 has been submitted as an update to Fedora EPEL 7. https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2018-5076e89a09
Comment 5 Fedora Update System 2018-04-17 03:04:49 UTC 
zanata-python-client-1.5.2-1.fc28 has been pushed to the Fedora 28 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2018-ee25309139
Comment 6 Fedora Update System 2018-04-18 02:11:56 UTC 
zanata-python-client-1.5.2-1.el7 has been pushed to the Fedora EPEL 7 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2018-5076e89a09
Comment 7 Fedora Update System 2018-04-18 02:59:58 UTC 
zanata-python-client-1.5.2-1.fc27 has been pushed to the Fedora 27 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2018-c5ad60747e
Comment 8 Fedora Update System 2018-04-25 17:59:23 UTC 
zanata-python-client-1.5.2-1.fc27 has been pushed to the Fedora 27 stable repository. If problems still persist, please make note of it in this bug report.
Comment 9 Fedora Update System 2018-04-27 04:04:22 UTC 
zanata-python-client-1.5.2-1.fc28 has been pushed to the Fedora 28 stable repository. If problems still persist, please make note of it in this bug report.
Note You need to log in before you can comment on or make changes to this bug.