Okay, that is definitely wrong but your earlier pakfire log doesn’t show that sort of time period. There is a 20 second time period for the running of the post upgrade scripts and then it finishes the core update 181 upgrade and checks for any addon packages that need to be updated. If the screen stays fixed for many hours but the logs show the machine continued and completed after some 10’s of seconds then that suggest a problem with the browser connection which might be related to apache not properly restarting as mentioned by @eddie
The apache package was upgraded in Core Update 181 due to several CVE vulnerabilities and a part of the update.sh script was to restart apache, ie stop it and then start it again but it looks like in your case after stopping apache it did not properly start again. Is there anything in the logs giving any hint as to why that happened?
1 Like
There are some permission denied errors in the log. Dunno if those are the culprit though.
See debian Pastezone
I updated yesterday and rebooted today.
Oh, line 57 - syntax error.
I’ve got three firewalls with the upgrade hung in a single location less than an hour away. I’ll get up there later tonight to restart them. Do you want a remote session so you can look at whatever you’d like on multiple systems after I restart? I did turn off the ip address blocklists prior to starting the upgrade so the kernel log shouldn’t be plastered with those…
Update hung and actually killed all internet for me. I could still ping the IPFire box but no WUI access and no access to the internet past it. I short pressed the power button on the box to manually trigger a safe shutdown and then started it back up again. It booted up with 181 and seems to have had no issues since.
Here are logs from another box that didn’t upgrade to 181 smoothly. If it’s of any value, when the GUI’s not available (other references to Apache), I am not able to login on the console. ipfire rejects the root password until restart.
EDIT : moderator changed text to code block.
IPFire diagnostics
Section: pakfire
Date: November 24, 2023
16:39:24 pakfire: PAKFIRE INFO: IPFire Pakfire 2.27-x86_64 started!
16:39:24 pakfire: CORE INFO: Checking for Core-Updates...
16:39:24 pakfire: CORE INFO: core-list.db is 44652 seconds old. - DEBUG: force
16:39:24 pakfire: DOWNLOAD STARTED: lists/core-list.db
16:39:24 pakfire: MIRROR INFO: 24 servers found in list
16:39:24 pakfire: DOWNLOAD INFO: Host: ipfire.earl-net.com (HTTPS) - File: pakfire2/2.27-x86_64/lists/core-list.db
16:39:24 pakfire: DOWNLOAD INFO: pakfire2/2.27-x86_64/lists/core-list.db has size of 903 bytes
16:39:25 pakfire: DOWNLOAD INFO: HTTP-Status-Code: 200 - 200 OK
16:39:25 pakfire: DOWNLOAD INFO: File received. Start checking signature...
16:39:25 pakfire: DOWNLOAD INFO: Signature of core-list.db is fine.
16:39:25 pakfire: DOWNLOAD FINISHED: pakfire2/2.27-x86_64/lists/core-list.db
16:39:25 pakfire: CORE UPGR: Upgrading from release 180 to 181
16:39:25 pakfire: DOWNLOAD STARTED: meta/meta-core-upgrade-181
16:39:25 pakfire: MIRROR INFO: 24 servers found in list
16:39:25 pakfire: DOWNLOAD INFO: Host: quantum-mirror.hu (HTTPS) - File: mirrors/pub/ipfire/pakfire2/2.27-x86_64/meta/meta-core-upgrade-181
16:39:26 pakfire: DOWNLOAD INFO: mirrors/pub/ipfire/pakfire2/2.27-x86_64/meta/meta-core-upgrade-181 has size of 1036 bytes
16:39:26 pakfire: DOWNLOAD INFO: HTTP-Status-Code: 200 - 200 OK
16:39:26 pakfire: DOWNLOAD INFO: File received. Start checking signature...
16:39:26 pakfire: DOWNLOAD INFO: Signature of meta-core-upgrade-181 is fine.
16:39:26 pakfire: DOWNLOAD FINISHED: mirrors/pub/ipfire/pakfire2/2.27-x86_64/meta/meta-core-upgrade-181
16:39:26 pakfire: DOWNLOAD STARTED: paks/core-upgrade-2.27-181.ipfire
16:39:26 pakfire: MIRROR INFO: 24 servers found in list
16:39:26 pakfire: DOWNLOAD INFO: Host: at.mirror.anexia.com (HTTPS) - File: ipfire/pakfire2/2.27-x86_64/paks/core-upgrade-2.27-181.ipfire
16:39:27 pakfire: DOWNLOAD INFO: ipfire/pakfire2/2.27-x86_64/paks/core-upgrade-2.27-181.ipfire has size of 77208942 bytes
16:40:45 pakfire: DOWNLOAD INFO: HTTP-Status-Code: 200 - 200 OK
16:40:45 pakfire: DOWNLOAD INFO: File received. Start checking signature...
16:40:46 pakfire: DOWNLOAD INFO: Signature of core-upgrade-2.27-181.ipfire is fine.
16:40:46 pakfire: DOWNLOAD FINISHED: ipfire/pakfire2/2.27-x86_64/paks/core-upgrade-2.27-181.ipfire
16:40:46 pakfire: PAKFIRE UPGR: core-upgrade-181: Decrypting...
16:40:46 pakfire: CLEANUP: tmp
16:40:46 pakfire: DECRYPT STARTED: core-upgrade-181
16:40:47 pakfire: DECRYPT FINISHED: core-upgrade-181 - Status: 0
16:40:47 pakfire: PAKFIRE UPGR: core-upgrade-181: Upgrading files and running post-upgrading scripts...
16:41:19 pakfire: CLEANUP: tmp
16:41:19 pakfire: PAKFIRE UPGR: core-upgrade-181: Finished.
16:41:19 pakfire: PAKFIRE INFO: Checking for package updates...
16:41:19 pakfire: DB INFO: packages_list.db is 44769 seconds old. - DEBUG: force
16:41:19 pakfire: DOWNLOAD STARTED: lists/packages_list.db
16:41:19 pakfire: MIRROR INFO: 24 servers found in list
16:41:19 pakfire: DOWNLOAD INFO: Host: muug.ca (HTTPS) - File: mirror/ipfire/pakfire2/2.27-x86_64/lists/packages_list.db
16:41:20 pakfire: DOWNLOAD INFO: mirror/ipfire/pakfire2/2.27-x86_64/lists/packages_list.db has size of 5309 bytes
16:41:20 pakfire: DOWNLOAD INFO: HTTP-Status-Code: 200 - 200 OK
16:41:20 pakfire: DOWNLOAD INFO: File received. Start checking signature...
16:41:20 pakfire: DOWNLOAD INFO: Signature of packages_list.db is fine.
16:41:20 pakfire: DOWNLOAD FINISHED: mirror/ipfire/pakfire2/2.27-x86_64/lists/packages_list.db
16:41:20 pakfire: PAKFIRE WARN: No new package upgrades available.
16:41:20 pakfire: PAKFIRE INFO: Pakfire has finished. Closing.
IPFire diagnostics
Section: kernel
Date: November 24, 2023
19:16:05 kernel: RTL8211E Gigabit Ethernet r8169-0-100:00: attached PHY driver (mii_bus:phy_addr=r8169-0-100:00, irq=MAC)
19:16:05 kernel: r8169 0000:01:00.0 red0: Link is Down
19:16:08 kernel: r8169 0000:01:00.0 red0: Link is Up - 1Gbps/Full - flow control off
19:16:08 kernel: e1000e 0000:00:19.0 green0: NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx
19:16:20 kernel: tun: Universal TUN/TAP device driver, 1.6
19:16:21 kernel: alg: No test for echainiv(authenc(hmac(sha256),cbc(aes))) (echainiv(authenc(hmac(sha256-generic),cbc-aes-aesni)))
19:16:31 kernel: i2c_dev: i2c /dev entries driver
19:16:31 kernel: i2c_dev: i2c /dev entries driver
I am just a hobby person. Never done remote sessions and not sure I would want to into other people’s systems.
From the logs the upgrade went without any problems.
Your system hangs after the line
Upgrading files and running post-upgrading scripts…
but the next command is logged 32 seconds later.
It looks like the WUI stops because Apache does not restart correctly for you for some reason, the same as for some other people that have reported in this thread.
This bit I don’t understand at all. The root password login at the console has nothing to do with Apache.
Although it is obviously very annoying and causing you a lot of grief, it does look like behind the scenes the upgrade went okay and doing a reboot allows the WUI to work properly again.
Based on apache not properly restarting for some people, I think we need to add a check into the upgrade.sh script to make certain that apache did restart, if an apache update is carried out.
Sorry I can’t be of more help at the moment.
same on my APU4d4. pakfire seems to have finished the update but wui/apache not running.
logon via console was possible
error_log in /var/log/httpd from yesterday, when i ran the update, shows the following
[root@myipfire01 httpd]# grep -i "Nov 24" error_log`
[Fri Nov 24 16:41:14.178891 2023] [cgid:error] [pid 8275:tid 139353617625280] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Fri Nov 24 16:41:14.181527 2023] [cgid:error] [pid 13136:tid 139353600812736] [client 10.0.3.2:65372] End of script output before headers: speed.cgi, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:15.326646 2023] [cgid:error] [pid 8278:tid 139353617625280] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Fri Nov 24 16:41:15.328501 2023] [cgid:error] [pid 13136:tid 139353368032960] [client 10.0.3.2:65370] End of script output before headers: pakfire.cgi, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:16.352154 2023] [cgid:error] [pid 8280:tid 139353617625280] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Fri Nov 24 16:41:16.353809 2023] [cgid:error] [pid 13136:tid 139353326069440] [client 10.0.3.2:65435] End of script output before headers: speed.cgi, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:17.349347 2023] [cgid:error] [pid 8282:tid 139353617625280] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Fri Nov 24 16:41:17.351136 2023] [cgid:error] [pid 13136:tid 139353477072576] [client 10.0.3.2:65436] End of script output before headers: pakfire.cgi, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:18.349898 2023] [cgid:error] [pid 8283:tid 139353617625280] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Fri Nov 24 16:41:18.351747 2023] [cgid:error] [pid 13136:tid 139353351247552] [client 10.0.3.2:65437] End of script output before headers: speed.cgi, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:19.352410 2023] [cgid:error] [pid 8284:tid 139353617625280] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Fri Nov 24 16:41:19.354259 2023] [cgid:error] [pid 13136:tid 139353493857984] [client 10.0.3.2:65438] End of script output before headers: pakfire.cgi, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:20.356040 2023] [cgid:error] [pid 8285:tid 139353617625280] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Fri Nov 24 16:41:20.357793 2023] [cgid:error] [pid 13136:tid 139353485465280] [client 10.0.3.2:65439] End of script output before headers: speed.cgi, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:21.355948 2023] [cgid:error] [pid 8286:tid 139353617625280] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Fri Nov 24 16:41:21.357649 2023] [cgid:error] [pid 13136:tid 139353342854848] [client 10.0.3.2:65440] End of script output before headers: pakfire.cgi, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:22.350373 2023] [cgid:error] [pid 8287:tid 139353617625280] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Fri Nov 24 16:41:22.352185 2023] [cgid:error] [pid 13136:tid 139353460287168] [client 10.0.3.2:65441] End of script output before headers: speed.cgi, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:23.364872 2023] [cgid:error] [pid 8288:tid 139353617625280] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Fri Nov 24 16:41:23.367028 2023] [cgid:error] [pid 13136:tid 139353368032960] [client 10.0.3.2:65442] End of script output before headers: pakfire.cgi, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:25.328701 2023] [core:error] [pid 13136:tid 139353451894464] (13)Permission denied: [client 10.0.3.2:65443] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:27.335766 2023] [core:error] [pid 13136:tid 139353477072576] (13)Permission denied: [client 10.0.3.2:65443] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:27.339631 2023] [core:error] [pid 13136:tid 139353334462144] (13)Permission denied: [client 10.0.3.2:65443] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:28.360168 2023] [core:error] [pid 13136:tid 139353359640256] (13)Permission denied: [client 10.0.3.2:65443] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:29.360042 2023] [core:error] [pid 13136:tid 139353493857984] (13)Permission denied: [client 10.0.3.2:65443] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:30.360187 2023] [core:error] [pid 13136:tid 139353502250688] (13)Permission denied: [client 10.0.3.2:65443] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:31.361788 2023] [core:error] [pid 13136:tid 139353485465280] (13)Permission denied: [client 10.0.3.2:65443] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:32.363708 2023] [core:error] [pid 13136:tid 139353584027328] (13)Permission denied: [client 10.0.3.2:65443] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:33.364559 2023] [core:error] [pid 13136:tid 139353342854848] (13)Permission denied: [client 10.0.3.2:65443] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:34.364631 2023] [core:error] [pid 13136:tid 139353600812736] (13)Permission denied: [client 10.0.3.2:65443] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://myipfire01.mydomain.lan:444/
[Fri Nov 24 16:41:44.230454 2023] [mpm_event:notice] [pid 5039:tid 139353617625280] AH00494: SIGHUP received. Attempting to restart
then restarted apache
[root@myipfire01 httpd]# /etc/init.d/apache restart
Restarting Apache daemon...
httpd not running, trying to start [ OK ]
an the error_log from today
[root@myipfire01 httpd]# grep -i "Nov 25" error_log
[Sat Nov 25 12:08:32.799300 2023] [ssl:warn] [pid 1431:tid 125097346740416] AH01909: myipfire01.mydomain.lan:444:0 server certificate does NOT include an ID which matches the server name
[Sat Nov 25 12:08:32.833089 2023] [ssl:warn] [pid 1432:tid 125097346740416] AH01909: myipfire01.mydomain.lan:444:0 server certificate does NOT include an ID which matches the server name
[Sat Nov 25 12:08:32.835612 2023] [core:warn] [pid 1432:tid 125097346740416] AH00098: pid file /var/run/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Sat Nov 25 12:08:32.840688 2023] [mpm_event:notice] [pid 1432:tid 125097346740416] AH00489: Apache/2.4.58 (Unix) OpenSSL/3.1.4 configured -- resuming normal operations
[Sat Nov 25 12:08:32.840942 2023] [core:notice] [pid 1432:tid 125097346740416] AH00094: Command line: '/usr/sbin/httpd'
maybe this can help to clarify the situation
The IPFire devs have also had one of their firewalls for the IPFire Infrastructure have the same problem. This allowed a closer look at what was happening.
What was reported was:-
Yes, I can confirm this. This happened on one of the firewalls in our infrastructure.
It seems that the runtime linker cache isn’t up to date at the time Apache is being restarted, and therefore it simply fails to restart.
However, ldconfig is executed before restarting apache, so I am not sure why this is happening.
It is however safe to reboot the affected systems after this point and Apache will come back up just fine.
So what is happening is now understood but not why it is happening.
4 Likes
I just updated and this problem did not happened to me. My machine is an APU2.
It hasn’t happened to the majority of people so there is probably some sort of delay in the linker process for some machines so that apache fails to find the required linked libraries when it tries to start.
3 Likes
During my update from CU 180 to CU 181 (on a PC Engine APU4D4), the WebGUI stalled for a long time after:
10:20:18 pakfire: PAKFIRE UPGR: core-upgrade-181: Upgrading files and running post-upgrading scri pts...
.
And I could no longer refresh the browser to see the System Logs > Pakfire log:
Note: I was watching the message log and the Pakfire WebGUI and the System Logs > Pakfire at the same time (a belts and suspenders approach!!)
For me it seems like the Apache restarted and after a minute or so it finally came back. Maybe something is timing out during the restart??
Apache finally started working, but then it stopped, waited, and then started again. Keep in mind I am seeing this from my browser and it displaying the WebGUI and then not displaying.
There are no references to Apache in the message logs. There are messages in the httpd > error log
[Sun Nov 26 09:55:17.255791 2023] [core:error] [pid 31949:tid 124702664144576] (70007)The timeout specified has expired: [client 192.168.60.212:54734] AH00574: ap_content_length_filter: apr_bucket_read() failed, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:05:02.933632 2023] [core:error] [pid 31949:tid 124702680929984] (70007)The timeout specified has expired: [client 192.168.60.212:57651] AH00574: ap_content_length_filter: apr_bucket_read() failed, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:30.279349 2023] [cgid:error] [pid 30884:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:30.284639 2023] [cgid:error] [pid 31949:tid 124702697715392] [client 192.168.60.212:49399] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:30.810333 2023] [cgid:error] [pid 30885:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:30.812930 2023] [cgid:error] [pid 31949:tid 124702798362304] [client 192.168.60.212:49946] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:31.077069 2023] [cgid:error] [pid 30886:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:31.081893 2023] [cgid:error] [pid 31949:tid 124702664144576] [client 192.168.60.212:50016] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:32.337705 2023] [cgid:error] [pid 30887:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:32.341779 2023] [cgid:error] [pid 31949:tid 124702781576896] [client 192.168.60.212:50024] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:32.849874 2023] [cgid:error] [pid 30892:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:32.852377 2023] [cgid:error] [pid 31949:tid 124702806755008] [client 192.168.60.212:50031] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:33.787879 2023] [cgid:error] [pid 30893:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Sun Nov 26 10:24:33.790362 2023] [cgid:error] [pid 31949:tid 124702831933120] [client 192.168.60.212:49320] End of script output before headers: pakfire.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:34.028659 2023] [cgid:error] [pid 30894:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:34.031572 2023] [cgid:error] [pid 31949:tid 124702815147712] [client 192.168.60.212:50040] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:34.279465 2023] [cgid:error] [pid 30895:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:34.282126 2023] [cgid:error] [pid 31949:tid 124702672537280] [client 192.168.60.212:50041] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:34.882606 2023] [cgid:error] [pid 30896:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:34.884984 2023] [cgid:error] [pid 31949:tid 124702680929984] [client 192.168.60.212:50044] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:34.973131 2023] [cgid:error] [pid 30897:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Sun Nov 26 10:24:34.975695 2023] [cgid:error] [pid 31949:tid 124702913717952] [client 192.168.60.212:50045] End of script output before headers: pakfire.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:35.559319 2023] [cgid:error] [pid 30899:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/logs.cgi/log.dat' failed
[Sun Nov 26 10:24:35.561932 2023] [cgid:error] [pid 31949:tid 124702697715392] [client 192.168.60.212:50052] End of script output before headers: log.dat, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:36.074747 2023] [cgid:error] [pid 30900:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Sun Nov 26 10:24:36.077146 2023] [cgid:error] [pid 31949:tid 124702664144576] [client 192.168.60.212:50056] End of script output before headers: pakfire.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:36.100123 2023] [cgid:error] [pid 30901:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:36.108909 2023] [cgid:error] [pid 31949:tid 124702689322688] [client 192.168.60.212:50054] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:36.256246 2023] [cgid:error] [pid 30902:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:36.261312 2023] [cgid:error] [pid 31949:tid 124702781576896] [client 192.168.60.212:50060] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:37.286849 2023] [cgid:error] [pid 30903:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Sun Nov 26 10:24:37.289302 2023] [cgid:error] [pid 31949:tid 124702789969600] [client 192.168.60.212:50065] End of script output before headers: pakfire.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:38.275040 2023] [cgid:error] [pid 30904:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:38.277696 2023] [cgid:error] [pid 31949:tid 124702655751872] [client 192.168.60.212:50073] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:38.386826 2023] [cgid:error] [pid 30905:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Sun Nov 26 10:24:38.389262 2023] [cgid:error] [pid 31949:tid 124702806755008] [client 192.168.60.212:50075] End of script output before headers: pakfire.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:38.593321 2023] [cgid:error] [pid 30906:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:38.595911 2023] [cgid:error] [pid 31949:tid 124702672537280] [client 192.168.60.212:50076] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:39.509988 2023] [cgid:error] [pid 30907:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Sun Nov 26 10:24:39.514402 2023] [cgid:error] [pid 31949:tid 124702555104960] [client 192.168.60.212:50084] End of script output before headers: pakfire.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:40.317722 2023] [cgid:error] [pid 30908:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:40.321114 2023] [cgid:error] [pid 31949:tid 124702680929984] [client 192.168.60.212:50090] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:40.598625 2023] [cgid:error] [pid 30909:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Sun Nov 26 10:24:40.606648 2023] [cgid:error] [pid 31949:tid 124702697715392] [client 192.168.60.212:50095] End of script output before headers: pakfire.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:40.648084 2023] [cgid:error] [pid 30910:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:40.651488 2023] [cgid:error] [pid 31949:tid 124702913717952] [client 192.168.60.212:50094] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:41.722693 2023] [cgid:error] [pid 30911:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Sun Nov 26 10:24:41.726014 2023] [cgid:error] [pid 31949:tid 124702664144576] [client 192.168.60.212:50106] End of script output before headers: pakfire.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:42.384684 2023] [cgid:error] [pid 30912:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:42.386831 2023] [cgid:error] [pid 31949:tid 124702689322688] [client 192.168.60.212:50113] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:42.601752 2023] [cgid:error] [pid 30913:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:42.604590 2023] [cgid:error] [pid 31949:tid 124702789969600] [client 192.168.60.212:50115] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:42.853641 2023] [cgid:error] [pid 30914:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Sun Nov 26 10:24:42.855652 2023] [cgid:error] [pid 31949:tid 124702655751872] [client 192.168.60.212:50117] End of script output before headers: pakfire.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:44.112308 2023] [cgid:error] [pid 30915:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Sun Nov 26 10:24:44.114450 2023] [cgid:error] [pid 31949:tid 124702815147712] [client 192.168.60.212:50126] End of script output before headers: pakfire.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:44.278682 2023] [cgid:error] [pid 30916:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/speed.cgi' failed
[Sun Nov 26 10:24:44.281159 2023] [cgid:error] [pid 31949:tid 124702672537280] [client 192.168.60.212:50130] End of script output before headers: speed.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:45.339707 2023] [cgid:error] [pid 30917:tid 124702930366656] (13)Permission denied: AH01241: exec of '/srv/web/ipfire/cgi-bin/pakfire.cgi' failed
[Sun Nov 26 10:24:45.342195 2023] [cgid:error] [pid 31949:tid 124702555104960] [client 192.168.60.212:50135] End of script output before headers: pakfire.cgi, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:46.494860 2023] [core:error] [pid 31949:tid 124702697715392] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:46.583137 2023] [core:error] [pid 31949:tid 124702913717952] (13)Permission denied: [client 192.168.60.212:50145] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:47.627709 2023] [core:error] [pid 31949:tid 124702823540416] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:48.166043 2023] [core:error] [pid 31949:tid 124702798362304] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:48.635594 2023] [core:error] [pid 31949:tid 124702664144576] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:49.641482 2023] [core:error] [pid 31949:tid 124702689322688] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:50.167054 2023] [core:error] [pid 31949:tid 124702563497664] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:50.653669 2023] [core:error] [pid 31949:tid 124702781576896] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:51.757655 2023] [core:error] [pid 31949:tid 124702789969600] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:52.167593 2023] [core:error] [pid 31949:tid 124702655751872] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:52.853145 2023] [core:error] [pid 31949:tid 124702806755008] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:53.858357 2023] [core:error] [pid 31949:tid 124702831933120] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:54.167573 2023] [core:error] [pid 31949:tid 124702815147712] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:54.807291 2023] [core:error] [pid 31949:tid 124702672537280] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:54.893635 2023] [core:error] [pid 31949:tid 124702555104960] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:55.899087 2023] [core:error] [pid 31949:tid 124702680929984] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:56.168198 2023] [core:error] [pid 31949:tid 124702697715392] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:56.904659 2023] [core:error] [pid 31949:tid 124702913717952] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:57.923912 2023] [core:error] [pid 31949:tid 124702823540416] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:58.168720 2023] [core:error] [pid 31949:tid 124702798362304] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:58.929592 2023] [core:error] [pid 31949:tid 124702664144576] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:24:59.935664 2023] [core:error] [pid 31949:tid 124702689322688] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:25:00.176601 2023] [core:error] [pid 31949:tid 124702563497664] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:25:00.941561 2023] [core:error] [pid 31949:tid 124702789969600] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:25:01.994318 2023] [core:error] [pid 31949:tid 124702655751872] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:25:02.170727 2023] [core:error] [pid 31949:tid 124702806755008] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:25:03.000844 2023] [core:error] [pid 31949:tid 124702831933120] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:25:04.007389 2023] [core:error] [pid 31949:tid 124702815147712] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:25:04.171105 2023] [core:error] [pid 31949:tid 124702672537280] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:25:05.040621 2023] [core:error] [pid 31949:tid 124702555104960] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:25:06.046836 2023] [core:error] [pid 31949:tid 124702680929984] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/pakfire.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:25:06.171916 2023] [core:error] [pid 31949:tid 124702697715392] (13)Permission denied: [client 192.168.60.212:50144] AH00035: access to /cgi-bin/speed.cgi denied (filesystem path '/srv/web') because search permissions are missing on a component of the path, referer: https://ipfire.localdomain:444/
[Sun Nov 26 10:25:19.398723 2023] [mpm_event:notice] [pid 3838:tid 124702930366656] AH00494: SIGHUP received. Attempting to restart
[Sun Nov 26 10:25:20.785820 2023] [ssl:warn] [pid 3838:tid 124702930366656] AH01882: Init: this version of mod_ssl was compiled against a newer library (OpenSSL 3.1.4 24 Oct 2023, version currently loaded is OpenSSL 3.1.2 1 Aug 2023) - may result in undefined or erroneous behavior
[Sun Nov 26 10:25:20.807057 2023] [mpm_event:notice] [pid 3838:tid 124702930366656] AH00489: Apache/2.4.57 (Unix) OpenSSL/3.1.2 configured -- resuming normal operations
[Sun Nov 26 10:25:20.807202 2023] [core:notice] [pid 3838:tid 124702930366656] AH00094: Command line: '/usr/sbin/httpd'
After the Apache stops and starts the pakfire came back and gave me the An update requires a restart! message. And it looks like the 181 updated completed.
EDIT: there seems to me lots of permission denied errors in the above logs…
EDIT2: and an odd OpenSSL message at the bottom of log…
Ha! the OpenSSL message includes the statement “may result in undefined or erroneous behavior” and this definitely applies! 
EDIT3: I saw there were updates to OpenSSL in CU 181 but I have no ideal if this is related to the original issue:
1 Like
I too found, after upgrading, that the Web GUI didn’t return. I didn’t diagnose it and left it for a day since internet access, samba, and VPN were working. The following day, when the Web GUI was still not working, I had to go to my IPFire device to logon and reboot it. I didn’t know if a reboot was required after the upgrade since the Web GUI didn’t return. i assumed it was and I didn’t know about starting apache.
I could provide logs but it looks like there are enough provided already. I appreciate these things slip through testing and this is only the second time in several years this has happened to me.
My concern is that if I’m away from home, say in another country, and I need to upgrade (which I can do via VPN) then can’t logon to the device, what do I do? My only option would be to ask someone to go to my home and do a hard reboot. I disable ssh by default.
For now, I’m going to add apache to my monit list. However, it would be nice if an IPFire device is never left in a state that prevents remote access. Perhaps when an upgrade is required, there is an optional checkbox to say that the device should be rebooted after the upgrade? You could even have a scheduled reboot after the upgrade. I’d prefer to take my chances with a reboot than to hope an update leaves the device remotely accessible.
When I do an update and I am not onsite, before the update I connect by SSH by activating the option on WEB UI. Just in case something like this happens. I also never reboot unless I am on site or I am willing to risk a disconnection.
2 Likes
This is indeed not optimal, but we currently only have very few people where the problem happens. Obviously it should not happen at all.
I just pushed a fix which will need a couple of hours to build:
https://git.ipfire.org/?p=ipfire-2.x.git;a=commitdiff;h=ece94c7edfa45b724ef05b57ff7a8a18c43fb99b
After the build is done, this problem should no longer arise at all.
3 Likes
I have got a weekly “scheduled action” -reboot- in the “Connection Scheduler”
3 Likes
@ms I appreciate all that the ipfire team do in providing a world class firewall. These things will happen occasionally. I want to have a contingency plan to minimise the impact when these issues slip through the testing net.
@cfusco thanks - that’s a good idea. The only other time I couldn’t access the server remotely was when VPN stopped working after an upgrade a few years ago! I think it was a result of that that I installed monit to restart certain essential services. In this case I didn’t allow for apache not starting – although as an ex-developer, I should have known better 
@ralph thanks - something like this occurred to me after I posted the message. I know I once considered scheduling a reboot but IPfire is so reliable, I’ve never required. However, I’ll reconsider. At the very least, when I’m away, I’ll schedule a restart for an hour (say) after the upgrade in case the system doesn’t come up and I can’t VPN/ssh (as per @cfusco idea) into the system.
I’ve also added apache to monit, which will now attempt to restart it. In case it helps others or someone has suggestions/comments, my monit restarts these services:
apache
apcupsd
dhcpd
nmbd
ntpd
openvpn
rsyncd
smbd
unbound
winbindd
Thanks again all for replies.
A fixed update has been pushed and as soon as all mirror servers have updated, this problem won’t arise any more.
It is safe to just reboot the firewall a couple of minutes after the update, or you can run “/etc/init.d/apache start” on the console and we the web UI will be back immediately.
4 Likes
same procedure for me.
The firewall works, but I can not connect to it.
I am not an experienced user.
Is there another workaround as to use the terminal-cable?
If not what cable should I buy and where?