Network bridge performance

Hi,

My system configuration is here. In short, Intel N100, 8GB RAM, and 6x i226V NICs.

I have four of the NICs bridged to green. When I iperf3 from any client to the IPFire box, I get (very close to) 2.5 Gbps, so that’s fine. When I iperf3 across the bridge between clients, I get between 1.4 and 1.8 Gpbs, fluctuating.

All MTUs are set to 9k. It doesn’t matter if IPS is turned on or off. CPU load measured with top is less than 5% for client to client and ~25% for client to IPFire.

Any suggestions to increase the bandwidth client-to-client? Is this some IRQ thing? I’m not really familiar with the details, but it looks like they are nicely distributed over cores:


[root@ipfire ~]# cat /proc/interrupts |grep green
 138:          0          2          0          0  IR-PCI-MSI 1048576-edge      green0p0
 139:          0          0     404052          0  IR-PCI-MSI 1048577-edge      green0p0-TxRx-0
 140:          0          0          0      33929  IR-PCI-MSI 1048578-edge      green0p0-TxRx-1
 141:      37858          0          0          0  IR-PCI-MSI 1048579-edge      green0p0-TxRx-2
 142:          0    2023243          0          0  IR-PCI-MSI 1048580-edge      green0p0-TxRx-3
 152:          0          0          2          0  IR-PCI-MSI 2097152-edge      green0p1
 153:          0          0          0    2744967  IR-PCI-MSI 2097153-edge      green0p1-TxRx-0
 154:    1140569          0          0          0  IR-PCI-MSI 2097154-edge      green0p1-TxRx-1
 155:          0     573042          0          0  IR-PCI-MSI 2097155-edge      green0p1-TxRx-2
 156:          0          0    1719658          0  IR-PCI-MSI 2097156-edge      green0p1-TxRx-3
 157:          8          0          0          0  IR-PCI-MSI 2621440-edge      green0p2
 158:          0      44584          0          0  IR-PCI-MSI 2621441-edge      green0p2-TxRx-0
 159:          0          0      42831          0  IR-PCI-MSI 2621442-edge      green0p2-TxRx-1
 160:          0          0          0      34109  IR-PCI-MSI 2621443-edge      green0p2-TxRx-2
 161:     134901          0          0          0  IR-PCI-MSI 2621444-edge      green0p2-TxRx-3
 162:          0          0          0          8  IR-PCI-MSI 3670016-edge      green0p3
 163:     534497          0          0          0  IR-PCI-MSI 3670017-edge      green0p3-TxRx-0
 164:          0    1165515          0          0  IR-PCI-MSI 3670018-edge      green0p3-TxRx-1
 165:          0          0     261379          0  IR-PCI-MSI 3670019-edge      green0p3-TxRx-2
 166:          0          0          0    1061938  IR-PCI-MSI 3670020-edge      green0p3-TxRx-3


Thanks!

Anyone?

Thanks.

I have been looking into link aggregation and Vlans as of late and found this, which might be connected to your question. LAGs + Bridge configuration via web ui.

PZ

Thanks.

/Jay