I have just tried reducing cache size to 1024MB RAM and 1024MB Disk to see if it will crash less often, but my old settings were 1280 RAM and 2000 Disk and it would become unresponsive after 3-10 days with a similar spike in Number of Processes and that started after the 183 or 184 CU for me, too.
The rest of my settings are the same as OP’s but my max object size is 4096 kb.
Although something I found that might be interesting is that when I loaded Epic Games, the number of processes spiked and I saw a lot of entries like this:
Try to turn it off the Cache-Manager in Version 185.
When I read it right, there is the new Squid Version 6.9.
In 183 and 184 I had many Proxy crashes. With the Cache-Manager I had it somewhat under control.
But with Version 185 you don’t need it anymore. Unless you really want it.
I tried unchecking the cache manager, since I wasn’t using it. It didn’t change anything as far as performance. At least with the cache size smaller it doesn’t seem to go unresponsive like before… so far (crosses fingers).
It went unresponsive again today. Cachemanager was disabled. When it gets like this I can’t even get the webproxy to stop in the WUI. I uncheck both transparent and green, then hit save and reload and the page never finishes loading, the services page still shows it running. I have to reboot the whole box to get it to shut down and come back up.
It doesn’t work with mine either.
Sry for my wrong hint.
Activate your Cache-Manager again and Try not to cache these domains which makes much traffic like epic games.
I’m not really sure what I’m looking for in those. They are both massive with lots of errors and warnings (drops, dns lookup errors) that I’m pretty sure are common. I can at least parse through the squid one for stuff that stands out in the noise and found.
2024/05/14 15:47:24| WARNING: BCP 177 violation. Detected non-functional IPv6 l>
2024/05/14 15:47:24| aclIpParseIpData: IPv6 has not been enabled.
2024/05/14 15:47:24| aclIpParseIpData: IPv6 has not been enabled.
2024/05/14 15:47:24| aclIpParseIpData: IPv6 has not been enabled.
'
and
May 14 18:21:51 squid-asnbl-helper[9675] WARN: No ASNBL configured. This is acc>
May 14 18:21:51 squid-asnbl-helper[9683] WARN: No ASNBL configured. This is acc>
May 14 18:21:52 squid-asnbl-helper[9679] WARN: No ASNBL configured. This is acc>
May 14 18:21:52 squid-asnbl-helper[9684] WARN: No ASNBL configured. This is acc>
May 14 18:21:52 squid-asnbl-helper[9674] WARN: No ASNBL configured. This is acc>
May 14 18:21:52 squid-asnbl-helper[9678] WARN: No ASNBL configured. This is acc>
May 14 18:21:52 squid-asnbl-helper[9680] WARN: No ASNBL configured. This is acc
which look like they stand out and may have happened around when it went non-responsive.
TBH, I am not sure as it is years ago that I ran into the problem. For a start, just monitor a single PC’s source IP and then narrow it down:
tcpdump -nni green0 host 111.222.333.444
My grey cells seem to also remember the proxy log was helpful and contained a lot of escaped characters.
AFAIK, if you’re using the disk cache, your cache should be on a disk about 16x faster than your internet link. With modern internet links, this generally means SSD or it will slow your connection. A SATA3 connection has a maximum bandwidth of 6000Mb/s so if your SSD could run at that max speed, it would start impacting your connection if it is >= 375Mb/s. SATA2 is only 3000Mb/s and plain old SATA, 1500Mb/s. For line speeds beyond that, you’ll want the cache on an NVMe SSD.
I’m not really interested in the cache part so much as the URL filter, so I set both cache sizes to 0 and the min and max object size to 0.
Is there a better way to run a proxy without a cache for the URL Filter? I’m curious to see if zero cache means that Squid won’t crash again.
Is it possible to have a RAM cache without an HDD cache? I thought I set the RAM cache larger than the HDD cache earlier and it kicked out an error saying that I couldn’t do that, but it looks like I can set a RAM cache with a HDD cache of 0 now, so I’m confused.
When @nickh wrote that maybe the internal SSD is not fast enough to save the cache on the Disk, my thoughts were the same to put the Disk Cache to Zero. Im testing some Scenario. This will be one of them. Maybe it will work better.
And when it is really possible to work like this, then maybe it is possible to put the maximal Object size to zero? To not to Cache.
I don’t know if it’s recommended to work like this. For me I only need the Web Proxy for the URL-Filter.
The thing that I don’t understand, first with the new Version 183 the Problem started.
And @phane you can try not to use your System-Proxy. You can put the Proxy-Information into your Browser like Firefox native or Google Chrome, Brave, Edge with the Proxy Switcher Addon.
When I was using squid, it was with v3.5.20. Not having a fast-enough SSD just slowed the internet connection. It did not cause any crashing of squid itself.
I am trying to remember my tcpdump diagnosis. I seem to remember I was trying to see if there was a traffic storm so the tcpdump query was not too important. It becomes obvious if there is a storm.
Since setting the cache to zero, my memory usage has stayed flat at around 50 mb and I’ve seen no spikes. URL filtering still seems to be working, so it’s probably a cache issue that, like others mentioned, started with CU 183.
Hello to all!
Thanks for the help!
I found the Problem and figured it out. The Problem was the Asix Ethernet Chip, that makes the Problem with the Proxy. I switched from Asix to Intel Ethernet Chip.
The Cache-Manager wouldnt help because it only cache unencrypted data. But most of the Internet is Encrypted and it wouldn’t work. When I understood it right. I’m sorry for my inexperience!
Thanks to all who try to help! You are a great community!
The mentioned bug was introduced in core186 so it has only affected the testing-tree systems. It also has nothing to do with squid. Early core186 installations doesn’t got a ethernet link with such asix88179 adapters.
