Internal Server Error after update to 188

Hello,

I own a Lightning Wire Labs mini appliance at home. Yesterday the OS was upgraded to version 188 as I went to sleep and this morning it is not possible to access the webui.

The network still works fine so far.
Using the serial monitor it was possible to connect to the appliance and the /var/log/httpd/error_log shows the following errors

[Wed Sep 18 08:24:31.036595 2024] [cgid:error] [pid 12325:tid 12348] [client 10.0.0.100:60158] End of script output before headers: index.cgi
Can't load '/usr/lib/perl5/site_perl/5.36.0/x86_64-linux-thread-multi/auto/RRDs/RRDs.so' for module RRDs: libpng12.so.0: cannot open shared object file: No such file or directory at /usr/lib/perl5/5.36.0/x86_64-linux-thread-multi/DynaLoader.pm line 206.
 at /var/ipfire/graphs.pl line 26.
Compilation failed in require at /var/ipfire/graphs.pl line 26.
BEGIN failed--compilation aborted at /var/ipfire/graphs.pl line 26.
Compilation failed in require at /var/ipfire/header.pl line 21.
Compilation failed in require at /srv/web/ipfire/cgi-bin/index.cgi line 32.
[Wed Sep 18 08:24:35.345234 2024] [cgid:error] [pid 12325:tid 12350] [client 10.0.0.100:60163] End of script output before headers: index.cgi
Can't load '/usr/lib/perl5/site_perl/5.36.0/x86_64-linux-thread-multi/auto/RRDs/RRDs.so' for module RRDs: libpng12.so.0: cannot open shared object file: No such file or directory at /usr/lib/perl5/5.36.0/x86_64-linux-thread-multi/DynaLoader.pm line 206.
 at /var/ipfire/graphs.pl line 26.
Compilation failed in require at /var/ipfire/graphs.pl line 26.
BEGIN failed--compilation aborted at /var/ipfire/graphs.pl line 26.
Compilation failed in require at /var/ipfire/header.pl line 21.
Compilation failed in require at /srv/web/ipfire/cgi-bin/pakfire.cgi line 32.
[Wed Sep 18 08:24:39.303649 2024] [cgid:error] [pid 12325:tid 12352] [client 10.0.0.100:60165] End of script output before headers: pakfire.cgi
Can't load '/usr/lib/perl5/site_perl/5.36.0/x86_64-linux-thread-multi/auto/RRDs/RRDs.so' for module RRDs: libpng12.so.0: cannot open shared object file: No such file or directory at /usr/lib/perl5/5.36.0/x86_64-linux-thread-multi/DynaLoader.pm line 206.
 at /var/ipfire/graphs.pl line 26.
Compilation failed in require at /var/ipfire/graphs.pl line 26.
BEGIN failed--compilation aborted at /var/ipfire/graphs.pl line 26.
Compilation failed in require at /var/ipfire/header.pl line 21.
Compilation failed in require at /srv/web/ipfire/cgi-bin/index.cgi line 32.
[Wed Sep 18 08:41:53.207530 2024] [cgid:error] [pid 12325:tid 12336] [client 10.0.0.100:33554] End of script output before headers: index.cgi

I tried to launch pakfire upgrade again, but pakfire says that I am on the latest version.
Screenshot 2024-09-18 08.51.35

After checking pakfire status, packfire shows that a reboot is required (which is not possible through the webui) and I rebooted the appliance.
Screenshot 2024-09-18 08.52.52

The network is still working, although I have no access to the webui.

This is what the access_log shows

0.0.0.100 - - [18/Sep/2024:08:24:30 +0200] "GET / HTTP/1.1" 302 -
10.0.0.100 - admin [18/Sep/2024:08:24:30 +0200] "GET /cgi-bin/index.cgi HTTP/1.1" 500 527
10.0.0.100 - - [18/Sep/2024:08:24:34 +0200] "GET / HTTP/1.1" 302 -
10.0.0.100 - admin [18/Sep/2024:08:24:34 +0200] "GET /cgi-bin/index.cgi HTTP/1.1" 500 527
10.0.0.100 - admin [18/Sep/2024:08:24:38 +0200] "GET /cgi-bin/pakfire.cgi?mode=logread HTTP/1.1" 500 527
10.0.0.100 - - [18/Sep/2024:08:26:29 +0200] "GET / HTTP/1.1" 302 -
10.0.0.100 - - [18/Sep/2024:08:26:29 +0200] "GET /cgi-bin/index.cgi HTTP/1.1" 401 381
10.0.0.100 - admin [18/Sep/2024:08:41:52 +0200] "GET /cgi-bin/index.cgi HTTP/1.1" 500 527
10.0.0.100 - admin [18/Sep/2024:08:54:50 +0200] "GET /cgi-bin/index.cgi HTTP/1.1" 500 527
10.0.0.100 - admin [18/Sep/2024:08:54:55 +0200] "GET /cgi-bin/index.cgi HTTP/1.1" 500 527

And here the error_log after the reboot

[Wed Sep 18 08:54:13.011162 2024] [core:notice] [pid 2954:tid 2954] AH00094: Command line: '/usr/sbin/httpd'
Can't load '/usr/lib/perl5/site_perl/5.36.0/x86_64-linux-thread-multi/auto/RRDs/RRDs.so' for module RRDs: libpng12.so.0: cannot open shared object file: No such file or directory at /usr/lib/perl5/5.36.0/x86_64-linux-thread-multi/DynaLo.
 at /var/ipfire/graphs.pl line 26.
Compilation failed in require at /var/ipfire/graphs.pl line 26.
BEGIN failed--compilation aborted at /var/ipfire/graphs.pl line 26.
Compilation failed in require at /var/ipfire/header.pl line 21.
Compilation failed in require at /srv/web/ipfire/cgi-bin/index.cgi line 32.
[Wed Sep 18 08:54:50.967377 2024] [cgid:error] [pid 2959:tid 2972] [client 10.0.0.100:57264] End of script output before headers: index.cgi
Can't load '/usr/lib/perl5/site_perl/5.36.0/x86_64-linux-thread-multi/auto/RRDs/RRDs.so' for module RRDs: libpng12.so.0: cannot open shared object file: No such file or directory at /usr/lib/perl5/5.36.0/x86_64-linux-thread-multi/DynaLo.
 at /var/ipfire/graphs.pl line 26.
Compilation failed in require at /var/ipfire/graphs.pl line 26.
BEGIN failed--compilation aborted at /var/ipfire/graphs.pl line 26.
Compilation failed in require at /var/ipfire/header.pl line 21.
Compilation failed in require at /srv/web/ipfire/cgi-bin/index.cgi line 32.
[Wed Sep 18 08:54:56.395629 2024] [cgid:error] [pid 2959:tid 2971] [client 10.0.0.100:53856] End of script output before headers: index.cgi

Any help is greatly appreciated

Thanks

rrd is looking for libpng12.so.0 and can’t find it.

That version of libpng was in IPFire in Core Update 166 and was removed in Core Update 167.

EDIT:
The library file was removed from IPFire in Core Update 166 but libpng had the library file updated from libpng12.so.0 to libpng16.so.0 in Core Update 145

What version of IPFire were you updating from?

Hi, I was uprading from 187

I follow all upgrades as far as possible.

That is very good but then I have no idea how you ended up with the rrd package trying to find a library that has not been used for 4 years.

Something very wrong must have happened in the update.

As it is not clear what could have gone wrong then there is no easy way to fix it so the easiest approach would be to do a fresh install and then do a restore from your latest backup.

I see and understand…
Let me figure out how to create and export a backup from command line and do a reinstall.

Thanks for your help so far.

At least now I know how that happened, I probably had to flash and old version

and the upgrades from there created the issues I am facing today

I found the docs about backups and will install the latest image right away

Thanks again

2 Likes