Internal network problem

Hello!

Sorry for the English, google translator did it. : D

There is a speed problem with the internal network.

The connection is 10g, but the speed is only 4-5g …

Debian server - ipfire

[root @ wrouter ~] # iperf3 -c 192.168.2.241
Connecting to host 192.168.2.241, port 5201
[5] local 192.168.2.1 port 36002 connected to 192.168.2.241 port 5201
[ID] Interval Transfer Bitrate Retr Cwnd
[5] 0.00-1.00 sec 435 MBytes 3.64 Gbits / sec 0 503 KBytes
[5] 1.00-2.00 sec 552 MBytes 4.63 Gbits / sec 0 611 KBytes
[5] 2.00-3.00 sec 542 MBytes 4.55 Gbits / sec 0 509 KBytes
[5] 3.00-4.00 sec 549 MBytes 4.61 Gbits / sec 0 648 KBytes
[5] 4.00-5.00 sec 562 MBytes 4.72 Gbits / sec 1,503 KBytes
[5] 5.00-6.00 sec 568 MBytes 4.76 Gbits / sec 0 543 KBytes
[5] 6.00-7.00 sec 572 MBytes 4.81 Gbits / sec 0 535 KBytes
[5] 7.00-8.00 sec 570 MBytes 4.77 Gbits / sec 0 628 KBytes
[5] 8.00-9.00 sec 568 MBytes 4.77 Gbits / sec 0 526 KBytes
[5] 9.00-10.00 sec 569 MBytes 4.76 Gbits / sec 0 571 KBytes


[ID] Interval Transfer Bitrate Retr
[5] 0.00-10.00 sec 5.36 GBytes 4.60 Gbits / sec 1 sender
[5] 0.00-10.00 sec 5.36 GBytes 4.60 Gbits / sec receiver

the speed is acceptable as a server but not perfect

ipfire server - debian client

[root @ wrouter ~] # iperf3 -s


Server listening on 5201 (test # 1)


Accepted connection from 192.168.2.241, port 36042
[5] local 192.168.2.1 port 5201 connected to 192.168.2.241 port 36044
[ID] Interval Transfer Bitrate
[5] 0.00-1.00 sec 779 MBytes 6.53 Gbits / sec
[5] 1.00-2.00 sec 1.10 GBytes 9.42 Gbits / sec
[5] 2.00-3.00 sec 1.10 GBytes 9.41 Gbits / sec
[5] 3.00-4.00 sec 1.09 GBytes 9.40 Gbits / sec
[5] 4.00-5.00 sec 1.08 GBytes 9.32 Gbits / sec
[5] 5.00-6.00 sec 1.10 GBytes 9.41 Gbits / sec
[5] 6.00-7.00 sec 1.10 GBytes 9.42 Gbits / sec
[5] 7.00-8.00 sec 1.09 GBytes 9.40 Gbits / sec
[5] 8.00-9.00 sec 1.09 GBytes 9.40 Gbits / sec
[5] 9.00-10.00 sec 1.09 GBytes 9.40 Gbits / sec
[5] 10.00-10.00 sec 636 KBytes 8.66 Gbits / sec


[ID] Interval Transfer Bitrate
[5] 0.00-10.00 sec 10.6 GBytes 9.11 Gbits / sec receiver

IPS is enabled, but only on the RED0 device.
I made another machine with a clean ipfire installation and tested the network cards, cables, sfp + modules and the speeds were good there, they brought what was expected. The machine called wrouter, on the other hand, is slow.

Machine data:
[root @ wrouter ~] # uname -a
Linux wrouter.srv 5.15.6-ipfire # 1 SMP Thu Dec 23 00:55:02 GMT 2021 x86_64 Intel (R) Xeon (R) CPU E5-2630L v2 @ 2.40GHz GenuineIntel GNU / Linux

https://fireinfo.ipfire.org/profile/5abcd62380db781461fcb0d15918c42fcf533c66

[root @ wrouter ~] # lspci | grep Ethernet
01: 00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
01: 00.1 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
01: 00.2 Ethernet Controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
01: 00.3 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
03: 00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller (rev 01)
48: 00.0 Ethernet controller: QLogic Corp. cLOM8214 1 / 10GbE Controller (rev 54)
48: 00.1 Ethernet controller: QLogic Corp. cLOM8214 1 / 10GbE Controller (rev 54)

[root @ wrouter ~] # ethtool green0
Settings for green0:
Supported ports: [TP ​​FIBER]
Supported link modes: 10000baseT / Full
Supported pause frame use: No
Supports auto-negotiation: No
Supported FEC modes: Not reported
Advertised link modes: 10000baseT / Full
Advertised pause frame use: No
Advertised auto-negotiation: No
Advertised FEC modes: Not reported
Speed: 10000Mb / s
Duplex: Full
Auto-negotiation: off
Port: FIBER
PHYAD: 0
Transceiver: internal
Supports Wake-on: g
Wake-on: g
Current message level: 0x00000000 (0)

    Link detected: yes

[root @ wrouter ~] # ifconfig green0
green0: flags = 4163 <UP, BROADCAST, RUNNING, MULTICAST> mtu 1500
inet 192.168.2.1 netmask 255.255.255.0 broadcast 0.0.0.0
ether c4: 34: 6b: cc: c0: c8 txqueuelen 1000 (Ethernet)
RX packets 59750684 bytes 86829590819 (80.8 GiB)
RX errors 0 dropped 1 overruns 0 frame 0
TX packets 65483441 bytes 96707241490 (90.0 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
device interrupt 113

What should I do to look for the bug?

If you disable IPS and leave everything else untouched, does it go up to 1 Gbits/sec? I am thinking that IPS could increase the CPU load and introduce a bottleneck there, regardless if it is analyzing the traffic of the green network or not. Also, is QoS active?

1 Like

Qos is active, I have already tried to turn off both completely separately and together, but nothing has changed

How can I see what can slow down my internal network?

Can you try to measure the CPU activity for all cores when you max out the bandwidth? I still think that for some reason you have a CPU bottleneck. Is it possible that you switch off the two services but for some reason either processes is/are still using CPU cycles?

1 Like

i will test the system again this week and check it out.

ipfire:

[root@wrouter ~]# iperf3 -c 192.168.2.241 -t 60
Connecting to host 192.168.2.241, port 5201
[  5] local 192.168.2.1 port 55188 connected to 192.168.2.241 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   662 MBytes  5.55 Gbits/sec    0    515 KBytes
[  5]   1.00-2.00   sec   836 MBytes  7.02 Gbits/sec    0    568 KBytes
[  5]   2.00-3.00   sec   918 MBytes  7.69 Gbits/sec    0    659 KBytes
[  5]   3.00-4.00   sec   916 MBytes  7.69 Gbits/sec    0    574 KBytes
[  5]   4.00-5.00   sec   924 MBytes  7.75 Gbits/sec    0    568 KBytes
[  5]   5.00-6.00   sec   905 MBytes  7.59 Gbits/sec    0    600 KBytes
[  5]   6.00-7.00   sec   906 MBytes  7.60 Gbits/sec    0    574 KBytes
[  5]   7.00-8.00   sec   904 MBytes  7.58 Gbits/sec    0    568 KBytes
[  5]   8.00-9.00   sec   911 MBytes  7.65 Gbits/sec    0    679 KBytes
[  5]   9.00-10.00  sec   906 MBytes  7.61 Gbits/sec    0    537 KBytes
[  5]  10.00-11.00  sec   891 MBytes  7.47 Gbits/sec    0    602 KBytes
[  5]  11.00-12.00  sec   722 MBytes  6.06 Gbits/sec    0    526 KBytes
[  5]  12.00-13.00  sec   895 MBytes  7.50 Gbits/sec    0    549 KBytes
[  5]  13.00-14.00  sec   902 MBytes  7.58 Gbits/sec    0    478 KBytes
[  5]  14.00-15.00  sec   896 MBytes  7.52 Gbits/sec    0    475 KBytes
[  5]  15.00-16.00  sec   909 MBytes  7.62 Gbits/sec    0    478 KBytes
[  5]  16.00-17.00  sec   906 MBytes  7.60 Gbits/sec    0    532 KBytes
[  5]  17.00-18.00  sec   896 MBytes  7.52 Gbits/sec    0    486 KBytes
[  5]  18.00-19.00  sec   900 MBytes  7.55 Gbits/sec    0    512 KBytes
[  5]  19.00-20.00  sec   928 MBytes  7.78 Gbits/sec    0    526 KBytes
[  5]  20.00-21.00  sec   945 MBytes  7.92 Gbits/sec    0    529 KBytes
[  5]  21.00-22.00  sec   731 MBytes  6.14 Gbits/sec    0    464 KBytes
[  5]  22.00-23.00  sec   892 MBytes  7.48 Gbits/sec    0    540 KBytes
[  5]  23.00-24.00  sec   905 MBytes  7.59 Gbits/sec    0    515 KBytes
[  5]  24.00-25.00  sec   890 MBytes  7.47 Gbits/sec    0    478 KBytes
[  5]  25.00-26.00  sec   894 MBytes  7.50 Gbits/sec    0    498 KBytes
[  5]  26.00-27.00  sec   891 MBytes  7.48 Gbits/sec    0    495 KBytes
[  5]  27.00-28.00  sec   891 MBytes  7.47 Gbits/sec    0    515 KBytes
[  5]  28.00-29.00  sec   889 MBytes  7.46 Gbits/sec    0    430 KBytes
[  5]  29.00-30.00  sec   900 MBytes  7.55 Gbits/sec    0    455 KBytes
[  5]  30.00-31.00  sec   896 MBytes  7.52 Gbits/sec    0    469 KBytes
[  5]  31.00-32.00  sec   736 MBytes  6.17 Gbits/sec    0    489 KBytes
[  5]  32.00-33.00  sec   894 MBytes  7.50 Gbits/sec    1    481 KBytes
[  5]  33.00-34.00  sec   906 MBytes  7.60 Gbits/sec    0    484 KBytes
[  5]  34.00-35.00  sec   910 MBytes  7.64 Gbits/sec    0    484 KBytes
[  5]  35.00-36.00  sec   895 MBytes  7.51 Gbits/sec    0    441 KBytes
[  5]  36.00-37.00  sec   895 MBytes  7.51 Gbits/sec    0    452 KBytes
[  5]  37.00-38.00  sec   894 MBytes  7.49 Gbits/sec    0    458 KBytes
[  5]  38.00-39.00  sec   906 MBytes  7.61 Gbits/sec    0    503 KBytes
[  5]  39.00-40.00  sec   900 MBytes  7.55 Gbits/sec    0    503 KBytes
[  5]  40.00-41.00  sec   906 MBytes  7.60 Gbits/sec    0    461 KBytes
[  5]  41.00-42.00  sec   745 MBytes  6.25 Gbits/sec    0    467 KBytes
[  5]  42.00-43.00  sec   900 MBytes  7.55 Gbits/sec    0    492 KBytes
[  5]  43.00-44.00  sec   912 MBytes  7.65 Gbits/sec    0    551 KBytes
[  5]  44.00-45.00  sec   906 MBytes  7.61 Gbits/sec    0    506 KBytes
[  5]  45.00-46.00  sec   895 MBytes  7.50 Gbits/sec    0    498 KBytes
[  5]  46.00-47.00  sec   911 MBytes  7.65 Gbits/sec    0    526 KBytes
[  5]  47.00-48.00  sec   918 MBytes  7.70 Gbits/sec    0    574 KBytes
[  5]  48.00-49.00  sec   911 MBytes  7.64 Gbits/sec    0    543 KBytes
[  5]  49.00-50.00  sec   916 MBytes  7.68 Gbits/sec    0    501 KBytes
[  5]  50.00-51.00  sec   911 MBytes  7.64 Gbits/sec    0    520 KBytes
[  5]  51.00-52.00  sec   821 MBytes  6.89 Gbits/sec    0   5.66 KBytes
[  5]  52.00-53.00  sec   598 MBytes  5.01 Gbits/sec    0    467 KBytes
[  5]  53.00-54.00  sec   648 MBytes  5.44 Gbits/sec    0    430 KBytes
[  5]  54.00-55.00  sec   658 MBytes  5.51 Gbits/sec    0    433 KBytes
[  5]  55.00-56.00  sec   666 MBytes  5.60 Gbits/sec    0    430 KBytes
[  5]  56.00-57.00  sec   680 MBytes  5.71 Gbits/sec    0    413 KBytes
[  5]  57.00-58.00  sec   662 MBytes  5.55 Gbits/sec    0    447 KBytes
[  5]  58.00-59.00  sec   675 MBytes  5.66 Gbits/sec    0    427 KBytes
[  5]  59.00-60.00  sec   672 MBytes  5.65 Gbits/sec    0    416 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-60.00  sec  50.0 GBytes  7.16 Gbits/sec    1             sender
[  5]   0.00-60.00  sec  50.0 GBytes  7.16 Gbits/sec                  receiver

iperf Done.
[root@wrouter ~]# cat /proc/interrupts
            CPU0       CPU1       CPU2       CPU3       CPU4       CPU5       CPU6       CPU7       CPU8       CPU9       CPU10      CPU11      CPU12      CPU13      CPU14      CPU15      CPU16      CPU17      CPU18      CPU19      CPU20      CPU21      CPU22      CPU23
   0:         16          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-IO-APIC    2-edge      timer
   8:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0         45          0          0          0  IR-IO-APIC    8-edge      rtc0
   9:          0          5          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-IO-APIC    9-fasteoi   acpi
  10:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0        285          0  IR-IO-APIC   10-edge      ipmi_si
  22:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0         50          0          0          0          0  IR-IO-APIC   22-fasteoi   ehci_hcd:usb2
  23:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     297106          0          0          0          0          0  IR-IO-APIC   23-fasteoi   ehci_hcd:usb1
  25:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 16384-edge      PCIe PME, aerdrv
  26:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 32768-edge      PCIe PME, aerdrv
  27:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 36864-edge      PCIe PME, aerdrv
  28:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 49152-edge      PCIe PME, aerdrv
  29:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 53248-edge      PCIe PME, aerdrv
  30:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 278528-edge      PCIe PME, aerdrv
  31:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 458752-edge      PCIe PME, aerdrv
  32:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 473088-edge      PCIe PME, aerdrv
  37:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 33570816-edge      PCIe PME, aerdrv
  38:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 33587200-edge      PCIe PME, aerdrv
  39:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 33603584-edge      PCIe PME, aerdrv
  40:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 33607680-edge      PCIe PME, aerdrv
  47:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   13680174  IR-IO-APIC    6-fasteoi   ath9k
  50:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 512000-edge      ahci[0000:00:1f.2]
  52:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0       9151          0          0  IR-PCI-MSI 1048576-edge      megasas6-msix0
  53:          0          0          0          0          0          0          0          0          0          0          0          0     643798          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 1048577-edge      megasas6-msix1
  54:          0          0          0          0          0          0          0          0          0          0          0          0          0     727839          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 1048578-edge      megasas6-msix2
  55:          0          0          0          0          0          0          0          0          0          0          0          0          0          0     668285          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 1048579-edge      megasas6-msix3
  56:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     685526          0          0          0          0          0          0          0          0  IR-PCI-MSI 1048580-edge      megasas6-msix4
  57:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     457687          0          0          0          0          0          0          0  IR-PCI-MSI 1048581-edge      megasas6-msix5
  58:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     567594          0          0          0          0          0          0  IR-PCI-MSI 1048582-edge      megasas6-msix6
  59:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     543709          0          0          0          0          0  IR-PCI-MSI 1048583-edge      megasas6-msix7
  60:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     537538          0          0          0          0  IR-PCI-MSI 1048584-edge      megasas6-msix8
  61:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     492656          0          0          0  IR-PCI-MSI 1048585-edge      megasas6-msix9
  62:          0          0          0          0          0          0          0          0          0     148222          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 1048586-edge      megasas6-msix10
  63:          0          0          0          0          0          0          0          0          0          0     203352          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 1048587-edge      megasas6-msix11
  64:          0          0          0          0          0          0          0          0          0          0          0     233922          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 1048588-edge      megasas6-msix12
  65:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     297303          0          0  IR-PCI-MSI 1048589-edge      megasas6-msix13
  66:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     190959          0  IR-PCI-MSI 1048590-edge      megasas6-msix14
  67:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     211615  IR-PCI-MSI 1048591-edge      megasas6-msix15
  69:          0          0          0          0          0          0          0          0          0   73771337          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 1572864-edge      red0
  88:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  DMAR-MSI    0-edge      dmar0
  89:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  DMAR-MSI    1-edge      dmar1
 113:          0     539402          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 37748736-edge      green0-rx-0
 114:          0          0    5840979          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 37748737-edge      green0-rx-1
 115:          0          0          0    1204996          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 37748738-edge      green0-rx-2
 116:          0          0          0          0    2017048          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 37748739-edge      green0-rx-3
 117:          0          0          0          0          0     801063          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 37748740-edge      green0-tx-0
 118:          0          0          0          0          0          0     634609          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 37748741-edge      green0-tx-1
 119:          0          0          0          0          0          0          0    2082417          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 37748742-edge      green0-tx-2
 120:          0          0          0          0          0          0          0          0    1348800          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  IR-PCI-MSI 37748743-edge      green0-tx-3
 NMI:         35         73         44         70         29         42         26         44         28        242         22        138         25         62         23         58         18         52         20         49         18         63         18         90   Non-maskable interrupts
 LOC:    2168537    5522080    3504888    5177210    3311509    2420947    4210928    3015167    4677551   17597272    2727853    4082656    2426643    3647445    2406147    4341127    1559211    4365485    1728937    3990653    1464015    3385030    5286923    2677148   Local timer interrupts
 SPU:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Spurious interrupts
 PMI:         35         73         44         70         29         42         26         44         28        242         22        138         25         62         23         58         18         52         20         49         18         63         18         90   Performance monitoring interrupts
 IWI:       2359      17379       5506       7946       3235       3667       1069       3526       1018     354424        557       7337       1200       4617        924       5799        647       6223       1075       7436       1142       5154       1430     268369   IRQ work interrupts
 RTR:         12          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   APIC ICR read retries
 RES:       2122      12567       5512       9355       3348       6681       2941       4838       2574      11124       2439      20036       2332      10729       2310      10832       2177      10100       2431       7975       2438       5444       2407      10564   Rescheduling interrupts
 CAL:    4773731    4669255    4655327    4621238    4585249    4629324    4560387    4616789    4564893    4688943    4508571    4657514    4477720    4710601    4490243    4667832    4426405    4618937    4473254    4604125    4441196    4587670    4498589    4588527   Function call interrupts
 TLB:      37107      16455      67732      29894      40563       7437       7068      11104       9336       7871       5425       7748      43520      12879      31968      11973      20514      12484      20474      20759      10075       4215        784       6554   TLB shootdowns
 TRM:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Thermal event interrupts
 THR:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Threshold APIC interrupts
 DFR:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Deferred Error APIC interrupts
 MCE:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Machine check exceptions
 MCP:        262        263        263        263        263        263        263        263        263        263        263        263        263        263        263        263        263        263        263        263        263        263        263        263   Machine check polls
 ERR:          0
 MIS:          0
 PIN:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Posted-interrupt notification event
 NPI:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Nested posted-interrupt event
 PIW:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Posted-interrupt wakeup event
[root@wrouter ~]#

debian:

Server listening on 5201
-----------------------------------------------------------
Accepted connection from 192.168.2.1, port 55186
[  5] local 192.168.2.241 port 5201 connected to 192.168.2.1 port 55188
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   661 MBytes  5.55 Gbits/sec
[  5]   1.00-2.00   sec   836 MBytes  7.01 Gbits/sec
[  5]   2.00-3.00   sec   917 MBytes  7.69 Gbits/sec
[  5]   3.00-4.00   sec   917 MBytes  7.69 Gbits/sec
[  5]   4.00-5.00   sec   924 MBytes  7.75 Gbits/sec
[  5]   5.00-6.00   sec   905 MBytes  7.59 Gbits/sec
[  5]   6.00-7.00   sec   906 MBytes  7.60 Gbits/sec
[  5]   7.00-8.00   sec   904 MBytes  7.58 Gbits/sec
[  5]   8.00-9.00   sec   912 MBytes  7.65 Gbits/sec
[  5]   9.00-10.00  sec   907 MBytes  7.60 Gbits/sec
[  5]  10.00-11.00  sec   891 MBytes  7.47 Gbits/sec
[  5]  11.00-12.00  sec   723 MBytes  6.06 Gbits/sec
[  5]  12.00-13.00  sec   894 MBytes  7.50 Gbits/sec
[  5]  13.00-14.00  sec   903 MBytes  7.57 Gbits/sec
[  5]  14.00-15.00  sec   896 MBytes  7.52 Gbits/sec
[  5]  15.00-16.00  sec   909 MBytes  7.62 Gbits/sec
[  5]  16.00-17.00  sec   906 MBytes  7.60 Gbits/sec
[  5]  17.00-18.00  sec   896 MBytes  7.52 Gbits/sec
[  5]  18.00-19.00  sec   900 MBytes  7.55 Gbits/sec
[  5]  19.00-20.00  sec   927 MBytes  7.78 Gbits/sec
[  5]  20.00-21.00  sec   944 MBytes  7.92 Gbits/sec
[  5]  21.00-22.00  sec   732 MBytes  6.14 Gbits/sec
[  5]  22.00-23.00  sec   892 MBytes  7.48 Gbits/sec
[  5]  23.00-24.00  sec   905 MBytes  7.59 Gbits/sec
[  5]  24.00-25.00  sec   891 MBytes  7.47 Gbits/sec
[  5]  25.00-26.00  sec   893 MBytes  7.49 Gbits/sec
[  5]  26.00-27.00  sec   891 MBytes  7.48 Gbits/sec
[  5]  27.00-28.00  sec   891 MBytes  7.47 Gbits/sec
[  5]  28.00-29.00  sec   889 MBytes  7.46 Gbits/sec
[  5]  29.00-30.00  sec   900 MBytes  7.55 Gbits/sec
[  5]  30.00-31.00  sec   896 MBytes  7.52 Gbits/sec
[  5]  31.00-32.00  sec   735 MBytes  6.17 Gbits/sec
[  5]  32.00-33.00  sec   894 MBytes  7.50 Gbits/sec
[  5]  33.00-34.00  sec   906 MBytes  7.60 Gbits/sec
[  5]  34.00-35.00  sec   910 MBytes  7.64 Gbits/sec
[  5]  35.00-36.00  sec   895 MBytes  7.51 Gbits/sec
[  5]  36.00-37.00  sec   895 MBytes  7.51 Gbits/sec
[  5]  37.00-38.00  sec   893 MBytes  7.49 Gbits/sec
[  5]  38.00-39.00  sec   907 MBytes  7.60 Gbits/sec
[  5]  39.00-40.00  sec   900 MBytes  7.55 Gbits/sec
[  5]  40.00-41.00  sec   906 MBytes  7.60 Gbits/sec
[  5]  41.00-42.00  sec   745 MBytes  6.25 Gbits/sec
[  5]  42.00-43.00  sec   900 MBytes  7.55 Gbits/sec
[  5]  43.00-44.00  sec   912 MBytes  7.65 Gbits/sec
[  5]  44.00-45.00  sec   907 MBytes  7.61 Gbits/sec
[  5]  45.00-46.00  sec   894 MBytes  7.50 Gbits/sec
[  5]  46.00-47.00  sec   911 MBytes  7.65 Gbits/sec
[  5]  47.00-48.00  sec   918 MBytes  7.70 Gbits/sec
[  5]  48.00-49.00  sec   911 MBytes  7.64 Gbits/sec
[  5]  49.00-50.00  sec   916 MBytes  7.68 Gbits/sec
[  5]  50.00-51.00  sec   911 MBytes  7.64 Gbits/sec
[  5]  51.00-52.00  sec   816 MBytes  6.85 Gbits/sec
[  5]  52.00-53.00  sec   603 MBytes  5.06 Gbits/sec
[  5]  53.00-54.00  sec   648 MBytes  5.43 Gbits/sec
[  5]  54.00-55.00  sec   656 MBytes  5.51 Gbits/sec
[  5]  55.00-56.00  sec   667 MBytes  5.60 Gbits/sec
[  5]  56.00-57.00  sec   680 MBytes  5.71 Gbits/sec
[  5]  57.00-58.00  sec   662 MBytes  5.55 Gbits/sec
[  5]  58.00-59.00  sec   675 MBytes  5.66 Gbits/sec
[  5]  59.00-60.00  sec   673 MBytes  5.65 Gbits/sec
[  5]  60.00-60.00  sec  1.60 MBytes  5.67 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-60.00  sec  50.0 GBytes  7.16 Gbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
iperf3: interrupt - the server has terminated
root@KAMERA:/home/whaskes# cat /proc/interrupts
           CPU0       CPU1       CPU2       CPU3       CPU4       CPU5       CPU6       CPU7
  0:          7          0          0          0          0          0          0          0  IR-IO-APIC   2-edge      timer
  1:          0          0          0          0          0          0          9          0  IR-IO-APIC   1-edge      i8042
  8:          0          0          0          0          0          0          0          1  IR-IO-APIC   8-edge      rtc0
  9:          0          5          0          0          0          0          0          0  IR-IO-APIC   9-fasteoi   acpi
 12:          0          0          0          0          0          2          0          0  IR-IO-APIC  12-edge      i8042
 16:          0          0          0         31          0          0          0          0  IR-IO-APIC  16-fasteoi   ehci_hcd:usb1
 18:          0          5          0          0          0          0          0          0  IR-IO-APIC  18-fasteoi   i801_smbus, ata_generic
 23:          0          0          0          0          0         33          0          0  IR-IO-APIC  23-fasteoi   ehci_hcd:usb2
 24:          0          0          0          0          0          0          0          0  DMAR-MSI   0-edge      dmar0
 25:          0          0          0          0          0          0          0          0  DMAR-MSI   1-edge      dmar1
 29:          0          0        576          0          0          0          0          0  IR-PCI-MSI 409600-edge      enp0s25
 30:          0          0          0          0          0          0          0          0  IR-PCI-MSI 1572864-edge      enp3s0
 31:          0          0          0          0          0          0          0        574  IR-PCI-MSI 1572865-edge      enp3s0-rx-0
 32:        574          0          0          0          0          0          0          0  IR-PCI-MSI 1572866-edge      enp3s0-rx-1
 33:          0        574          0          0          0          0          0          0  IR-PCI-MSI 1572867-edge      enp3s0-tx-0
 34:          0          0        574          0          0          0          0          0  IR-PCI-MSI 1572868-edge      enp3s0-tx-1
 35:          0          0          0          0      20911          0          0          0  IR-PCI-MSI 512000-edge      ahci[0000:00:1f.2]
 36:          0          0          0          0          5          0          0          0  IR-PCI-MSI 524288-edge      enp1s0f0
 38:          0          0          0          0          0          3          0          0  IR-PCI-MSI 524290-edge      enp1s0f0-fp-0
 39:          0          0          0          0          0          0          3          0  IR-PCI-MSI 524291-edge      enp1s0f0-fp-1
 40:          0          0          0          0          0          0          0          3  IR-PCI-MSI 524292-edge      enp1s0f0-fp-2
 41:          3          0          0          0          0          0          0          0  IR-PCI-MSI 524293-edge      enp1s0f0-fp-3
 42:          0          3          0          0          0          0          0          0  IR-PCI-MSI 524294-edge      enp1s0f0-fp-4
 43:          0          0          3          0          0          0          0          0  IR-PCI-MSI 524295-edge      enp1s0f0-fp-5
 44:          0          0          0          3          0          0          0          0  IR-PCI-MSI 524296-edge      enp1s0f0-fp-6
 45:          0          0          0          0          3          0          0          0  IR-PCI-MSI 524297-edge      enp1s0f0-fp-7
 46:          0          0          0          0          0       1135          0          0  IR-PCI-MSI 526336-edge      enp1s0f1
 48:          0          0          0          0          0          0    1389542          0  IR-PCI-MSI 526338-edge      enp1s0f1-fp-0
 49:          0          0          0          0          0          0          0    2350376  IR-PCI-MSI 526339-edge      enp1s0f1-fp-1
 50:     418051          0          0          0          0          0          0          0  IR-PCI-MSI 526340-edge      enp1s0f1-fp-2
 51:          0         62          0          0          0          0          0          0  IR-PCI-MSI 526341-edge      enp1s0f1-fp-3
 52:          0          0     269430          0          0          0          0          0  IR-PCI-MSI 526342-edge      enp1s0f1-fp-4
 53:          0          0          0         85          0          0          0          0  IR-PCI-MSI 526343-edge      enp1s0f1-fp-5
 54:          0          0          0          0     180710          0          0          0  IR-PCI-MSI 526344-edge      enp1s0f1-fp-6
 55:          0          0          0          0          0      98671          0          0  IR-PCI-MSI 526345-edge      enp1s0f1-fp-7
 56:          0          0          0          0          0          0        171          0  IR-PCI-MSI 327680-edge      xhci_hcd
 57:          0          0          0          0          0          0          0       3280  IR-PCI-MSI 32768-edge      i915
 58:          0         42          0          0          0          0          0          0  IR-PCI-MSI 360448-edge      mei_me
 59:          0          0        268          0          0          0          0          0  IR-PCI-MSI 49152-edge      snd_hda_intel:card0
 60:          0          0          0       1015          0          0          0          0  IR-PCI-MSI 442368-edge      snd_hda_intel:card1
NMI:          2          1          1          1          1          0          2          6   Non-maskable interrupts
LOC:      18349      21531      13339      11465      17729      10691      29154      28539   Local timer interrupts
SPU:          0          0          0          0          0          0          0          0   Spurious interrupts
PMI:          2          1          1          1          1          0          2          6   Performance monitoring interrupts
IWI:        214         80        372        104         63        143         49       2813   IRQ work interrupts
RTR:          0          0          0          0          0          0          0          0   APIC ICR read retries
RES:        833        962        599        691        965        713      20210       1015   Rescheduling interrupts
CAL:       7348       7928       5322       4874       5407       5082       8323      10856   Function call interrupts
TLB:       1010        641       1247        606        970       1321        919        836   TLB shootdowns
TRM:          0          0          0          0          0          0          0          0   Thermal event interrupts
THR:          0          0          0          0          0          0          0          0   Threshold APIC interrupts
DFR:          0          0          0          0          0          0          0          0   Deferred Error APIC interrupts
MCE:          0          0          0          0          0          0          0          0   Machine check exceptions
MCP:          4          5          5          5          5          5          5          5   Machine check polls
ERR:          0
MIS:          0
PIN:          0          0          0          0          0          0          0          0   Posted-interrupt notification event
NPI:          0          0          0          0          0          0          0          0   Nested posted-interrupt event
PIW:          0          0          0          0          0          0          0          0   Posted-interrupt wakeup event

type or paste code here
root@KAMERA:/home/whaskes# /usr/sbin/ethtool enp1s0f1
Settings for enp1s0f1:
        Supported ports: [ FIBRE ]
        Supported link modes:   1000baseT/Full
                                10000baseT/Full
        Supported pause frame use: Symmetric Receive-only
        Supports auto-negotiation: No
        Supported FEC modes: Not reported
        Advertised link modes:  10000baseT/Full
        Advertised pause frame use: No
        Advertised auto-negotiation: No
        Advertised FEC modes: Not reported
        Speed: 10000Mb/s
        Duplex: Full
        Auto-negotiation: off
        Port: FIBRE
        PHYAD: 1
        Transceiver: internal
        Supports Wake-on: g
        Wake-on: d
        Current message level: 0x00000000 (0)

        Link detected: yes

ipfire: iperf3 -V

Test Complete. Summary Results:
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-60.00  sec  34.2 GBytes  4.89 Gbits/sec    0             sender
[  5]   0.00-60.00  sec  34.2 GBytes  4.89 Gbits/sec                  receiver
CPU Utilization: local/sender 98.8% (0.4%u/98.4%s), remote/receiver 36.2% (3.6%u/32.6%s)
snd_tcp_congestion bbr
rcv_tcp_congestion cubic

iperf Done.

debian iperf3 -V

Test Complete. Summary Results:
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-60.00  sec  65.1 GBytes  9.32 Gbits/sec    0             sender
[  5]   0.00-60.00  sec  65.1 GBytes  9.32 Gbits/sec                  receiver
CPU Utilization: local/sender 59.0% (1.8%u/57.2%s), remote/receiver 52.3% (3.1%u/49.2%s)
snd_tcp_congestion cubic
rcv_tcp_congestion bbr

iperf Done.


When I measure with iperf3, only one CPU core works, sometimes it switches to another, here is an image from the top. Where can I tell this to better distribute tasks between CPU cores? Looking for software or bios?

[root@wrouter ~]# top
top - 13:06:26 up 56 min,  2 users,  load average: 0.70, 0.66, 0.77
Tasks: 349 total,   2 running, 347 sleeping,   0 stopped,   0 zombie
%Cpu0  :   0.0/0.0     0[                                                                                                    ]
%Cpu1  :   0.0/18.6   19[|||||||||||||||||||                                                                                 ]
%Cpu2  :   0.0/0.0     0[                                                                                                    ]
%Cpu3  :   0.7/0.7     1[||                                                                                                  ]
%Cpu4  :   0.0/0.0     0[                                                                                                    ]
%Cpu5  :   0.0/0.7     1[|                                                                                                   ]
%Cpu6  :   0.0/0.0     0[                                                                                                    ]
%Cpu7  :   0.0/0.0     0[                                                                                                    ]
%Cpu8  :   0.0/0.0     0[                                                                                                    ]
%Cpu9  :   0.0/0.0     0[                                                                                                    ]
%Cpu10 :   0.6/0.6     1[||                                                                                                  ]
%Cpu11 :   0.0/0.0     0[                                                                                                    ]
%Cpu12 :   0.0/0.0     0[                                                                                                    ]
%Cpu13 :   0.0/0.7     1[|                                                                                                   ]
%Cpu14 :   0.7/99.3  100[||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||]
%Cpu15 :   0.7/0.7     1[||                                                                                                  ]
%Cpu16 :   0.7/1.3     2[||                                                                                                  ]
%Cpu17 :   0.0/0.0     0[                                                                                                    ]
%Cpu18 :   0.0/0.0     0[                                                                                                    ]
%Cpu19 :   0.0/0.0     0[                                                                                                    ]
%Cpu20 :   0.0/0.0     0[                                                                                                    ]
%Cpu21 :   0.7/0.7     1[||                                                                                                  ]
%Cpu22 :   0.0/0.0     0[                                                                                                    ]
%Cpu23 :   0.7/1.3     2[||                                                                                                  ]
GiB Mem : 13.6/31.3     [                                                                                                    ]
GiB Swap:  0.0/1.0      [                                                                                                    ]

The ability to use multiple cores is something defined by the bios firmware. However it is not something that can be selected from the bios. The firmware is either written to spread the load over cores or it is not.

The CPU bottle neck hypothesis seems to be correct. Even if you have a multicore, only one core is used maxing out the speed. Unfortunately there is nothing you can do, the firmware is responsible for distributing the workload, as @bonnietwin has said. When choosing the hardware for a firewall it is necessary to check both how the ethernet cards communicate with the CPU and if the CPU handles properly the multithread system. There are several discussion about this topic in IPFire forums.

Personally, I decided that my next machine will be one that has been tested for a firewall job by people that know what they are doing. In the IPFire case, a lightning wire lab appliance

4 Likes

I tried the dell r720 with a debian live system. Iperf3 ran perfectly well, showed good bandwidth, 10 gigabytes, and the CPU worked well. If I boot the system with ipfirel, it will only run around 5 giga. I think the hardware problem is ruled out. Any ideas?

It’s not only the firmware/bios. This need only to activate the cores and a few CPU options.

Multitasking over more then one core is a combination of three things:

  • Bios with correct options

  • Program logic parallelization with different tasks

  • OS which spreads the different tasks to different cores.
    This can only work if the OS knows the processor.

If the firewall process use only one task, it can only run on one core…

And I found one interesting point… IPFire don’t know my AMD processor completely, the CPU frequency Graph variable cpu9A0 is unknown…

I guess the Debian system is using features like hardware offloading and the like. Thus part of the heavy lifting is happening outside the cpu. I’ve read somewhere - I think on the suricata website - that hardware offloading would mess with the packet order so ips systems get problems when tracking connections and recommend to disable such features.
I do however have a problem imagining that your processor can’t handle 10g on its own. While you haven’t said what chip you have the impressive number of cores hints at some better chipset. Do you have error messages regarding drivers for your network card (s) in ipfire?

There are no error messages about anything in the log.

My machine is a Dell PowerEdge R720-8BAY-LFF-CTO with 2 Xeon E5-2630Lv2 cpu

My previous machine had a Kontron KTQM87 / mITX motherboard running an Intel I7 4860eq processor. There was no problem with that in IPFire. Utilized 4 cores / 8 threads with a 10g connection, iperf3 showed good speeds. Suricata is disabled, only enabled on the RED0 network card.

CPU

fireinfo

[root@wrouter ~]# lspci
00:00.0 Host bridge: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 DMI2 (rev 04)
00:01.0 PCI bridge: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 1a (rev 04)
00:02.0 PCI bridge: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 2a (rev 04)
00:02.2 PCI bridge: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 2c (rev 04)
00:03.0 PCI bridge: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 3a (rev 04)
00:03.2 PCI bridge: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 3c (rev 04)
00:05.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 VTd/Memory Map/Misc (rev 04)
00:05.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 IIO RAS (rev 04)
00:11.0 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Virtual Root Port (rev 05)
00:16.0 Communication controller: Intel Corporation C600/X79 series chipset MEI Controller #1 (rev 05)
00:16.1 Communication controller: Intel Corporation C600/X79 series chipset MEI Controller #2 (rev 05)
00:1a.0 USB controller: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #2 (rev 05)
00:1c.0 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Root Port 1 (rev b5)
00:1c.7 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Root Port 8 (rev b5)
00:1d.0 USB controller: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #1 (rev 05)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a5)
00:1f.0 ISA bridge: Intel Corporation C600/X79 series chipset LPC Controller (rev 05)
00:1f.2 SATA controller: Intel Corporation C600/X79 series chipset 6-Port SATA AHCI Controller (rev 05)
01:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
01:00.1 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
01:00.2 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
01:00.3 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
02:00.0 RAID bus controller: Broadcom / LSI MegaRAID SAS 2208 [Thunderbolt] (rev 05)
03:00.0 Ethernet controller: QLogic Corp. cLOM8214 1/10GbE Controller (rev 54)
03:00.1 Ethernet controller: QLogic Corp. cLOM8214 1/10GbE Controller (rev 54)
04:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller (rev 01)
08:00.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe Switch [PS]
09:00.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe Switch [PS]
09:01.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe Switch [PS]
0a:00.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe-PCI Bridge [PPB]
0b:00.0 VGA compatible controller: Matrox Electronics Systems Ltd. G200eR2
3f:08.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Link 0 (rev 04)
3f:09.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Link 1 (rev 04)
3f:0a.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 0 (rev 04)
3f:0a.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 1 (rev 04)
3f:0a.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 2 (rev 04)
3f:0a.3 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 3 (rev 04)
3f:0b.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 UBOX Registers (rev 04)
3f:0b.3 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 UBOX Registers (rev 04)
3f:0c.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
3f:0c.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
3f:0c.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
3f:0d.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
3f:0d.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
3f:0d.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
3f:0e.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Home Agent 0 (rev 04)
3f:0e.1 Performance counters: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Home Agent 0 (rev 04)
3f:0f.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Target Address/Thermal Registers (rev 04)
3f:0f.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 RAS Registers (rev 04)
3f:0f.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers (rev 04)
3f:0f.3 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers (rev 04)
3f:0f.4 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers (rev 04)
3f:0f.5 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers (rev 04)
3f:10.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 0 (rev 04)
3f:10.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 1 (rev 04)
3f:10.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 0 (rev 04)
3f:10.3 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 1 (rev 04)
3f:10.4 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 2 (rev 04)
3f:10.5 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 3 (rev 04)
3f:10.7 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 3 (rev 04)
3f:13.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 R2PCIe (rev 04)
3f:13.1 Performance counters: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 R2PCIe (rev 04)
3f:13.4 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Ring Registers (rev 04)
3f:13.5 Performance counters: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Ring Performance Ring Monitoring (rev 04)
3f:16.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 System Address Decoder (rev 04)
3f:16.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Broadcast Registers (rev 04)
3f:16.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Broadcast Registers (rev 04)
40:01.0 PCI bridge: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 1a (rev 04)
40:02.0 PCI bridge: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 2a (rev 04)
40:03.0 PCI bridge: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 3a (rev 04)
40:03.2 PCI bridge: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 3c (rev 04)
40:05.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 VTd/Memory Map/Misc (rev 04)
40:05.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 IIO RAS (rev 04)
41:00.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
42:01.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
42:04.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
42:05.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
42:07.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
42:09.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
46:00.0 Network controller: Qualcomm Atheros AR958x 802.11abgn Wireless Network Adapter (rev 01)
7f:08.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Link 0 (rev 04)
7f:09.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Link 1 (rev 04)
7f:0a.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 0 (rev 04)
7f:0a.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 1 (rev 04)
7f:0a.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 2 (rev 04)
7f:0a.3 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 3 (rev 04)
7f:0b.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 UBOX Registers (rev 04)
7f:0b.3 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 UBOX Registers (rev 04)
7f:0c.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
7f:0c.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
7f:0c.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
7f:0d.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
7f:0d.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
7f:0d.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers (rev 04)
7f:0e.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Home Agent 0 (rev 04)
7f:0e.1 Performance counters: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Home Agent 0 (rev 04)
7f:0f.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Target Address/Thermal Registers (rev 04)
7f:0f.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 RAS Registers (rev 04)
7f:0f.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers (rev 04)
7f:0f.3 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers (rev 04)
7f:0f.4 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers (rev 04)
7f:0f.5 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers (rev 04)
7f:10.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 0 (rev 04)
7f:10.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 1 (rev 04)
7f:10.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 0 (rev 04)
7f:10.3 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 1 (rev 04)
7f:10.4 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 2 (rev 04)
7f:10.5 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 3 (rev 04)
7f:10.7 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 3 (rev 04)
7f:13.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 R2PCIe (rev 04)
7f:13.1 Performance counters: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 R2PCIe (rev 04)
7f:13.4 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Ring Registers (rev 04)
7f:13.5 Performance counters: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Ring Performance Ring Monitoring (rev 04)
7f:16.0 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 System Address Decoder (rev 04)
7f:16.1 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Broadcast Registers (rev 04)
7f:16.2 System peripheral: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Broadcast Registers (rev 04)```

Honestly, I‘m at a loss here. The specs of your machine should be enough even if it would only utilize 1 core I‘d say. I had the same opinion @cfusco had. But now I‘m not sure if there isn‘t another problem. Sorry, I don‘t know enough to diagnose that further.