Note: This is a public test instance of Red Hat Bugzilla. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback at bugzilla.redhat.com.
Bug 1639043 - update of lighttpd package from 1.4.49 to 1.4.50 causes pi-hole admin console to fail at startup.
Summary: update of lighttpd package from 1.4.49 to 1.4.50 causes pi-hole admin console...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Fedora
Classification: Fedora
Component: lighttpd
Version: 28
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Gwyn Ciesla
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-10-14 19:11 UTC by Laine Stump
Modified: 2018-10-30 17:27 UTC (History)
4 users (show)

Fixed In Version: lighttpd-1.4.51-1.fc28 lighttpd-1.4.51-1.fc27 lighttpd-1.4.51-1.fc29
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2018-10-23 21:07:55 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)
pi-hole lighttpd.conf (3.48 KB, text/plain)
2018-10-16 01:34 UTC, Laine Stump
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 1615360 0 unspecified CLOSED lighttpd-1.4.50 is available 2022-05-16 11:32:56 UTC

Internal Links: 1615360

Description Laine Stump 2018-10-14 19:11:21 UTC
I have pi-hole (https://pi-hole.net) running on an F28 (x86) virtual machine After several months of it just sitting there doing its thing with no interference, tonight I ran "dnf update; pihole -up", then rebooted. When it came back up the webadmin interface was no longer reachable. netstat -na shows only ports 53 and 22 tcp listening. I tried "systemctl start lightttpd" and I see this message in the system logs:

lighttpd[1205]:  2018-10-13 20:20:59: (configfile.c.1451) pclose "cat external.conf 2>/dev/null"failed: Success
lighttpd[1205]: 2018-10-13 20:20:59: (configfile.c.1289) source: /etc/lighttpd/lighttpd.conf line: 94 pos: 1 parser failed somehow near here: (EOL)
systemd[1]: lighttpd.service: Main process exited, code=exited, status=255/n/a
systemd[1]: lighttpd.service: Failed with result 'exit-code'.

I also tried a complete repair/reinstall of pihole (with "pihole -r", and then by uninstalling pi-hole and lighttpd and installing from scratch with the curl command on the front page of the pi-hole website. Same result. (rebooted after each try for good measure)

So I ran "yum downgrade lighttpd-*" which brought it back from 1.4.50-1 to 1.4.49-4, and now everything again works.

This is fairly easy to reproduce by just installing pi-hole on a clean F28 system (using the single command on the above-referenced web page).

Comment 1 Anssi Johansson 2018-10-14 20:57:10 UTC
If lighttpd complains about an error in the config, wouldn't you think it would make sense to attach the config to the bug so that people would be able to examine it?

Comment 2 Anssi Johansson 2018-10-14 21:07:31 UTC
https://redmine.lighttpd.net/issues/2910 may be related.

Comment 3 Laine Stump 2018-10-15 02:22:20 UTC
(In reply to Anssi Johansson from comment #1)
> If lighttpd complains about an error in the config, wouldn't you think it
> would make sense to attach the config to the bug so that people would be
> able to examine it?

Not necessarily. A single file from an unknowledgeable reporter might help, or it might just create extra content with no value, or be missing some crucial other file that was needed. I considered attaching the lightttpd.conf file, but then figured it was just as likely due to some other file that was included (and which I wouldn't know about, since I have only used lighttpd unknowingly as part of an appliance), so I decided it would be more prudent to explain a simple way (literally a single shell line) to reproduce the problem, and then if anyone looking at the BZ asked for specific files, I would attach them.

In the meantime, pi-hole devs pointed me to this posting:

https://discourse.pi-hole.net/t/fresh-install-and-web-admin-page-not-work/12926

and, as suggested there, creating an empty external.conf allows me to use lighttpd-1.4.50. I won't pretend to know whether or not that's the same problem you've referenced, but if it is, and if that patch is making its way downstream, then we're done here :-) (since the problem has been worked around on my system, and anyone else encountering it before the fix gets to a Fedora package can just do the same thing).

Comment 4 Anssi Johansson 2018-10-15 08:03:05 UTC
Not everyone has immediate access to fresh throwaway Fedora installations. Sure, VMs can be spun up, but clicking on a "See attachment lighttpd.conf" is much quicker. In any case, I ended examining the installation script and then noticed that it replaces the conf file with pi-hole's own.

I believe this bug has been fixed in lighttpd 1.4.51, released today.

Comment 5 Fedora Update System 2018-10-15 13:56:46 UTC
lighttpd-1.4.51-1.fc29 has been submitted as an update to Fedora 29. https://bodhi.fedoraproject.org/updates/FEDORA-2018-cd5a9c3c0f

Comment 6 Fedora Update System 2018-10-15 13:56:54 UTC
lighttpd-1.4.51-1.fc27 has been submitted as an update to Fedora 27. https://bodhi.fedoraproject.org/updates/FEDORA-2018-de6d032aae

Comment 7 Fedora Update System 2018-10-15 13:57:01 UTC
lighttpd-1.4.51-1.fc28 has been submitted as an update to Fedora 28. https://bodhi.fedoraproject.org/updates/FEDORA-2018-a31054181a

Comment 8 Laine Stump 2018-10-16 01:34:35 UTC
Created attachment 1494207 [details]
pi-hole lighttpd.conf

Comment 9 Laine Stump 2018-10-16 01:37:28 UTC
Thanks for looking into this so quickly. My expectation of Fedora BZes is that at least half of them will just be closed EOL because the maintainers are too overloaded, so it's nice to see action. :-)

Since you were so quick to respond, I decided I need to also be quick to test. I downloaded 1.4.51 of the three lighttpd packages used on the machine from bodhi (they hadn't madde it into updates-testing yet) and restarted, and unfortunately the problem persists (if I create an empty external.conf, then the problem disappears.)

So since it wasn't fixed by the new release, and you've asked for the .conf file, I'm attaching it. (My final comment on not attaching it to begin with - I've had more than my share of BZes where the reporter attached tons of irrelevant noise, and just made it too long to filter out the useful stuff, so I tend to go minimalist when I report (esp. if I don't know what would/wouldn't be relevant), then if someone asks for more specifics, I'll send them.)

I also logged into bodhi and left a +1 karma (but -1 for fixing this BZ) for the package, just in case that helps it along to the updates repo.

Comment 10 Anssi Johansson 2018-10-16 05:46:38 UTC
OK, now I actually tested this myself (on CentOS 7, but that's probably similar enough).

You initially reported that you got this error message: pclose "cat external.conf 2>/dev/null"failed: Success

I believe that the error message you got changed with 1.4.51: commaned "cat external.conf 2>/dev/null" exited non-zero: 1

Looking at https://github.com/lighttpd/lighttpd1.4/blob/master/src/configfile.c#L1461 it looks like the change to return an error if the executed command returns an error is intentional. Maybe you (or pi-hole) should arrange it so that the executed command would not return an error, either by having that external.conf in place or by: include_shell "cat external.conf 2>/dev/null; exit 0"

Comment 11 Fedora Update System 2018-10-16 11:56:54 UTC
lighttpd-1.4.51-1.fc27 has been pushed to the Fedora 27 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2018-de6d032aae

Comment 12 Fedora Update System 2018-10-16 12:37:29 UTC
lighttpd-1.4.51-1.fc28 has been pushed to the Fedora 28 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2018-a31054181a

Comment 13 Glenn S 2018-10-16 13:51:06 UTC
Yes, lighttpd config file processing intentionally errors out if the 'include_shell' command fails.

As an alternative, use lighttpd.conf 'include' with a file glob instead of 'include_shell'.  'include' with a file glob will include the files from the file glob, and will not error out if the file glob returns zero files.

include "external*.conf"

Comment 14 Fedora Update System 2018-10-16 15:51:09 UTC
lighttpd-1.4.51-1.fc29 has been pushed to the Fedora 29 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2018-cd5a9c3c0f

Comment 15 Glenn S 2018-10-17 11:01:20 UTC
Patch submitted upstream as pull request in https://github.com/pi-hole/pi-hole/pull/2468

Comment 16 Fedora Update System 2018-10-23 21:07:55 UTC
lighttpd-1.4.51-1.fc28 has been pushed to the Fedora 28 stable repository. If problems still persist, please make note of it in this bug report.

Comment 17 Fedora Update System 2018-10-23 21:24:30 UTC
lighttpd-1.4.51-1.fc27 has been pushed to the Fedora 27 stable repository. If problems still persist, please make note of it in this bug report.

Comment 18 Fedora Update System 2018-10-30 17:27:16 UTC
lighttpd-1.4.51-1.fc29 has been pushed to the Fedora 29 stable repository. If problems still persist, please make note of it in this bug report.


Note You need to log in before you can comment on or make changes to this bug.