" There is the potential for this tool to report results inconsistent with Speedtest.net. There are several concepts to be aware of that factor into the potential inconsistency:
1. Speedtest.net has migrated to using pure socket tests instead of HTTP based tests 2. This application is written in Python 3. Different versions of Python will execute certain parts of the code faster than others 4. CPU and Memory capacity and speed will play a large part in inconsistency between Speedtest.net and even other machines on the same network
Issues relating to inconsistencies will be closed as wontfix and without additional reason or context."
Benchmark the provider during the days/weeks. Most of ISP are in overbooking
And having some stats for understand/know the real performance, QoS can be adjusted and you can bug your ISP asking “Please improve my service”
After reading the above I started keeping track of Internet speeds. I was not looking for “blazing fast at all times!”. But when the speeds went low it made it easy to complain. (the breaks in the graph are when there was no Internet service)
@ms Why did you remove from https://wiki.ipfire.org/addons/speedtest-cli the quote from speedtest-cli Github page that provide users with a heads up about the potential for results inconsistency? I think this is very relevant to anyone who uses speedtest-cli.
sorry for not leaving a comment on this (I need to add that to the wiki when we do a rollback).
I thought that it would be better to either link this discussion or reference it elsewhere. I do not think that we need to have an extra paragraph on the wiki for this, because I consider these speed tests always as unreliable. Benchmarks are always flawed in one way or another. I highly doubt that this is because of the Python implementation.
Speed tests are just some kind of indication about what has gone through your link at a certain point in time. They are not reproducible at all.
I agree, however, for me, running IPFire in my home lab, speedtest-cli delivers enough information to get at least an impression what’s going on or if the speed decreases significantly over a a certain period of time.