Note: This is a public test instance of Red Hat Bugzilla. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback at bugzilla.redhat.com.
Bug 1135632
| Summary: | utf8 error decoding broken in py2 after py3 patch | ||
|---|---|---|---|
| Product: | [Fedora] Fedora | Reporter: | James Antill <james.antill> |
| Component: | python-urlgrabber | Assignee: | Tomas 'Sheldon' Radej <tradej> |
| Status: | CLOSED RAWHIDE | QA Contact: | Fedora Extras Quality Assurance <extras-qa> |
| Severity: | unspecified | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | rawhide | CC: | dgilmore, ignatenko, kevin, packaging-team-maint, rjones, tradej |
| Target Milestone: | --- | ||
| Target Release: | --- | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | python-urlgrabber-0:3.10.1-6.fc22.noarch | Doc Type: | Bug Fix |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2014-10-29 10:20:32 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | 1138270 | ||
| Bug Blocks: | 910269 | ||
It's been untagged, so it's not urgent to get a new build out ... see if you can speak to some rel-eng people so you can do a dry run before doing another build in rawhide. It actually didn't get untagged in time, but I just did so and am restarting rawhide compose. I'll take a look at this. Can you please give me logs or more information about where this problem arose, so that I can debug it? Thank you. TR You can see the full traceback in the mash logs: http://koji.fedoraproject.org/mash/rawhide-20140830.broken/logs/mash.log *** Bug 1135680 has been marked as a duplicate of this bug. *** I filed the duplicate bug 1135680. FWIW the problem has stopped happening now in Rawhide & F21. As far as I know I didn't change anything my end. (In reply to Richard W.M. Jones from comment #6) > I filed the duplicate bug 1135680. FWIW the problem has stopped > happening now in Rawhide & F21. As far as I know I didn't change > anything my end. Both bugs were caused by my patch for python-urlgrabber. The build thereof was untagged, which is why it's working again. I have a patch ready for urlgrabber that should fix both the issues, and will be posting it shortly. *** Bug 1138270 has been marked as a duplicate of this bug. *** The culpable code which added Python 3 compatibility was reverted, so I am marking this as fixed. |
Description of problem: The rawhide compose returned this after the py3 patch went in: Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1307, in _retrieve self.fo.write(buf.decode('utf-8')) File "/usr/lib64/python2.7/encodings/utf_8.py", line 16, in decode return codecs.utf_8_decode(input, errors, True) UnicodeDecodeError: 'utf8' codec can't decode byte 0xfd in position 0: invalid start byte Traceback (most recent call last): File "/usr/libexec/urlgrabber-ext-down", line 75, in <module> main() File "/usr/libexec/urlgrabber-ext-down", line 61, in main fo = PyCurlFileObject(opts.url, opts.filename, opts) File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1262, in __init__ self._do_open() File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1613, in _do_open self._do_grab() File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1749, in _do_grab Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1307, in _retrieve self.fo.write(buf.decode('utf-8')) File "/usr/lib64/python2.7/encodings/utf_8.py", line 16, in decode return codecs.utf_8_decode(input, errors, True) UnicodeDecodeError: 'utf8' codec can't decode byte 0xfd in position 0: invalid start byte Traceback (most recent call last): File "/usr/libexec/urlgrabber-ext-down", line 75, in <module> main() File "/usr/libexec/urlgrabber-ext-down", line 61, in main fo = PyCurlFileObject(opts.url, opts.filename, opts) File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1262, in __init__ self._do_open() File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1613, in _do_open self._do_grab() File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1749, in _do_grab self._do_perform() File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1527, in _do_perform self._do_perform() File "/usr/lib/python2.7/site-packages/urlgrabber/grabber.py", line 1527, in _do_perform raise getattr(self, '_cb_error', KeyboardInterrupt) KeyboardInterrupt raise getattr(self, '_cb_error', KeyboardInterrupt) KeyboardInterrupt Exiting on user cancel error: Child process exited with code 1 ...which is: if not six.PY3 or isinstance(self.fo, StringIO): self.fo.write(buf.decode('utf-8')) else: self.fo.write(buf)