Pakfire slow over serial console

First i give a big thank you for the latest core!

it works perfect!

I have a strange “feeling”:

i am runnig the pakfire upgrade over the serial console.

this works perfect but the downloads of the core update files feels really slow.

i have the feeling this is slowed because of the slow progress rendering over the serial console?

i am on 300 Mbit fiber so a 100 MB download should be done in seconds but in my setup it take several minutes.

is this a thing or do i start seeing things??

11:02:58 pakfire: DOWNLOAD FINISHED: ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire
11:02:58 pakfire: DOWNLOAD INFO: Signature of core-upgrade-2.29-198.ipfire is fine.
11:02:56 pakfire: DOWNLOAD INFO: File received. Start checking signature…
11:02:55 pakfire: DOWNLOAD INFO: HTTP-Status-Code: 200 - 200 OK
11:01:03 pakfire: DOWNLOAD INFO: ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire has size of 60046479 bytes
11:01:02 pakfire: DOWNLOAD INFO: Host: mirror.clarkson.edu (HTTPS) - File: ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire

if i “wget” the file, it took 19 seconds…

Greetz

:thinking:

Why not use SSH?

For daily use ssh into the ipfire box for sure.

But for update purposes i recommend the “live” terminal to see all messages on the console and not to loose the connection to the box in any case.

Spotting messages during the whole boot process can came in handy from time to time.

Call me crazy but i like this level of “control”

As I said, it is not a problem at all, but my inner monk would like to know is my educated guess somehow correct.

Greetz

3 Likes

:game_die:
seems to be a bad choice of :mirror: for the download :man_shrugging:

was the wget with the exact same link :thinking:

let us see if the coredevteam confirms
that there is no difference using ssh or serial :hourglass_not_done:

and :+1: for pakfire via serial :cat_with_wry_smile:

2 Likes

It was the exact same url i am wgeting..

It is not a big deal i am just curious

i greped the log files:

CORE SIZE DURATION URL
190 80MB 02:32 https://muug.ca/mirror/ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-190.ipfire
191 47MB 01:30 https://mirror.ihost.md/ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-191.ipfire
192 82MB 02:38 https://mirror.vtti.vt.edu/ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-192.ipfire
193 105MB 04:24 https://mirror.marwan.ma/ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-193.ipfire
194 82MB 11:12 https://ftp.yz.yamagata-u.ac.jp/pub/network/security/ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-194.ipfire
195 15MB 00:30 https://mirror7.ipfire.org/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-195.ipfire
196 106MB 03:25 https://mirror.clarkson.edu/ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-196.ipfire
197 85MB 02:45 https://mirror.csclub.uwaterloo.ca/ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-197.ipfire
198 60MB 01:56 https://mirror.clarkson.edu/ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire

Greetz

I have run some tests on a physical device to see if I could replicate what you are seeing.

I installed CU197 on the device and then I ran the update to CU198 from the console command line with pakfire upgrade

Log showed the following

12:41:40 pakfire:  DOWNLOAD STARTED: paks/core-upgrade-2.29-198.ipfire
12:41:40 pakfire:  MIRROR INFO: 24 servers found in list
12:41:40 pakfire:  DOWNLOAD INFO: Host: mirror.cedia.org.ec (HTTPS) - File: ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire
12:41:42 pakfire:  DOWNLOAD INFO: ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire has size of 60046479 bytes
12:42:15 pakfire:  DOWNLOAD INFO: HTTP-Status-Code: 200 - 200 OK
12:42:16 pakfire:  DOWNLOAD INFO: File received. Start checking signature...
12:42:18 pakfire:  DOWNLOAD INFO: Signature of core-upgrade-2.29-198.ipfire is fine.
12:42:18 pakfire:  DOWNLOAD FINISHED: ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire

The download time was 38 seconds.

I then re-installed CU197 on the same system and ran the update via the WUI and got the following log

13:11:59 pakfire:  DOWNLOAD STARTED: paks/core-upgrade-2.29-198.ipfire
13:11:59 pakfire:  MIRROR INFO: 24 servers found in list
13:11:59 pakfire:  DOWNLOAD INFO: Host: mirrors.ocf.berkeley.edu (HTTPS) - File: ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire
13:11:59 pakfire:  DOWNLOAD INFO: ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire has size of 60046479 bytes
13:12:08 pakfire:  DOWNLOAD INFO: HTTP-Status-Code: 200 - 200 OK
13:12:09 pakfire:  DOWNLOAD INFO: File received. Start checking signature...
13:12:11 pakfire:  DOWNLOAD INFO: Signature of core-upgrade-2.29-198.ipfire is fine.
13:12:11 pakfire:  DOWNLOAD FINISHED: ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire

The download time was 12 seconds.

A bit faster but note that the mirror was different. First time was a mirror from ecuador and the second time from USA. The routing paths could easily make a difference in the download times, especially as there was a 18 minute gap between the two tests due to the full installation step.

So I then did another fresh install of CU197 on the device and then ran the update again but with the mirror defined as mirrors.ocf.berkeley.edu again. Logs showed

14:13:29 pakfire:  DOWNLOAD STARTED: paks/core-upgrade-2.29-198.ipfire
14:13:29 pakfire:  DOWNLOAD INFO: Host: mirrors.ocf.berkeley.edu (HTTPS) - File: /ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire
14:13:30 pakfire:  DOWNLOAD INFO: /ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire has size of 60046479 bytes
14:13:41 pakfire:  DOWNLOAD INFO: HTTP-Status-Code: 200 - 200 OK
14:13:42 pakfire:  DOWNLOAD INFO: File received. Start checking signature...
14:13:44 pakfire:  DOWNLOAD INFO: Signature of core-upgrade-2.29-198.ipfire is fine.
14:13:44 pakfire:  DOWNLOAD FINISHED: /ipfire/pakfire2/2.29-x86_64/paks/core-upgrade-2.29-198.ipfire

giving a download time of 15 seconds. This compares very similarly with the WUI time with the same mirror of 12 seconds and especially as there was a gap of 58 minutes between the two tests with the same mirror due to the full installation step plus I had to go and work on some other stuff.

So from my perspective I don’t see any big difference between the pakfire upgrade download via the console command line or the WUI.

Just as a confirmation, when you say you are using the console is this via hdmi for the screen and usb for the keyboard or are you using the serial console.

If the latter then I could believe that there might be an impact but I am not currently able to test this and if the WUI is faster for you then that seems fine as the WUI is the intended upgrade route. The console approach for pakfire is there to be availabe as a backup route if something goes wrong with the WUI access.

1 Like

Adolf, thank you so much for your time and investigations!

As I said, this is not problem at all i am just curious to know!

I am using a headless APU, so no hdmi! This is plan old RS232ing into the box..

I never messed with the pakfire mirrors, but for me (located in Germany) is a mirror in Japan really strange to be choosen by pakfire.

For my further personal tests I pinned the pakfire mirror now fix to the gwdg mirror, which is in Germany too.

Greetz to all the ipfire members

If you use an APU system, could you please answer following questions.

  • Which CU do you use?
  • Is IPS enabled?

I am not sure why you think it is strange.

This ensures that all the mirror volunteers get any load on them distributed and not concentrated on the mirrors where the biggest population of IPFire users is.

With the internet and our mirrors being worldwide, I have to say that I have not seen any issue with download speeds of the upgrade packages or addons.

Having a range of mirrors that has distributed usage also ensures that if there is some downtime on a mirror the system just moves to the next available one. I have seen that occur in updates where a mirror did not respond but the change to the new mirror just kicked in automatically with very little time impact.

Then you might have an impact, although I am not familiar enough with the serial interface to know that definitively. In that case you will have to just live with a slower download or use the WUI pakfire for the updates/upgrades.
The logs that are shown in the pakfire window are the same logs that you see in the console window.

If you want to see how the reboot goes then you can always run the upgrade via the WUI and then go and look at the serial interface for the reboot. You should be able to do that with the same laptop for both.

IPS is disabled and was never used.

i am on CU 198. (from 189 in one go on last Saturday :shushing_face:)