Didr / netbenches

Network forwarding performance benchmark results

netbenches

FreeBSD network forwarding performance benchmark results

This repository includes bench scripts (need netmap pkt-gen and nanobsd like), bench configuration files, raw results and gnuplot graphs on few setups. Bench script documentation is available too.

Hardware benched are:

• Dell PowerEdgre R630 (2x12 cores Intel Xeon E5-2650 @ 2.2GHz) and: Intel 82599, Chelsio T520-CR, Mellanox ConnectX-3 and ConnectX-4
• HP ProLiant DL360p Gen8 (8 cores Intel Xeon E5-2650 @ 2.60GHz) and 10-Gigabit Chelsio T540-CR
• SuperMicro SuperServer 5018A-FTN4 (8 cores Atom C2758) and 10-Gigabit Chelsio T540-CR
• SuperMicro SuperServer 5018A-FTN4 (8 cores Atom C2758) and 10-Gigabit Intel 82599
• Netgate RCC-VE 4860 (4 cores Intel Atom C2558) and quad port Intel i350 (the 2 Intel i211 are not benched)
• PC Engines APU2C4 (4 cores AMD GX-412TC) and 4 Intel i210AT Gigabit NIC

Some results:

• ipfw/pf/ipf's impact on forwarding performance:

  • Impact of firewalls on forwarding performance with 2x12 cores Xeon E5-2650 & Mellanox ConnectX-4
  • Impact of firewalls on forwarding performance with 8 cores Xeon E5-2650 & Chelsio T540
  • Impact of firewalls on forwarding performance with 8 cores Atom C2758 & Chelsio T540
  • Impact of firewalls on forwarding performance with 8 cores Atom C2758 & Intel 82599
  • Impact of firewalls on forwarding performance with 4 cores Atom C2558 & Intel i350
  • Impact of firewalls on forwarding performance with 4 cores AMD GX-412TC & Intel i210
  • (old)Impact of firewalls on forwarding performance with 4 cores Xeon L5630
  • (old)Impact of firewalls on forwarding performance with 2 cores AMD G-T40E
  • One year (2017) of forwarding performance with 8 cores Xeon E5-2650 & Chelsio T540
  • One year (2017) of forwarding performance with 4 cores Atom 2558 & Intel i350
  • One year (2016) of forwarding performance with 8 cores Atom 2758 & Chelsio T540
  • One year (2016) of forwarding performance with 4 cores Atom 2558 & Intel i350
  • One year (2016) of forwarding performance with 4 cores AMD GX-412TC & Intel i210
  • One year (2015) of fastforwarding performance evolution with with 8 cores Xeon E5-2650
  • One year (2015) of fastforwarding performance evolution with 4 cores Atom C2558

• comparing 12-head and 11-stable:

  • fbsd12-head vs 11-stable r318516 with 4 cores AMD GX-412TC

• comparing 11.0 and 11.1-BETA1:

  • FreeBSD 11.0 vs 11.1-BETA1 on a 8 cores Xeon E5-2650 with Chelsio T540
  • FreeBSD 11.0 vs 11.1-BETA1 on a 4 cores AMD GX-412TC with Intel i210

• Impact of entropy sources:

  • Impact of random.harvest.mask on forwarding performance with 8 cores Xeon E5-2650
  • Impact of random.harvest.mask on forwarding performance with 8 cores Atom C2758
  • Impact of random.harvest.mask on forwarding performance with 4 cores Atom C2558
  • Impact of random.harvest.mask on forwarding performance with 4 cores AMD GX-412TC

• Impact of adding VIMAGE support (without using it):

  • Impact of adding VIMAGE on forwarding/pf/ipfw performance with 8 cores Xeon E5-2650
  • Impact of adding VIMAGE on forwarding/pf/ipfw performance with 8 cores Atom C2758
  • Impact of adding VIMAGE on forwarding/pf/ipfw performance with 4 cores Atom C2558
  • Impact of adding VIMAGE on forwarding/pf/ipfw performance with 4 cores AMD GX-412TC
  • Impact of adding VIMAGE on forwarding/pf/ipfw performance with 4 cores Xeon L5630

• Impact of Intel's TurboBoost

  • Impact of TurboBoost on forwarding performance with 8 cores Atom C2758 & Chelsio T540
  • Impact of TurboBoost on forwarding performance with 8 cores Atom C2758 & Intel 82599

• Impact of a software bridge

  • Impact of an if_bridge on forwarding performance with 8 cores cores Xeon E5-2650
  • Impact of an if_bridge on forwarding performance with 8 cores Atom C2758 & Chelsio T540

• Impact of enabling ALTQ

  • Impat of enabling ALTQ on forwarding performance with 4 cores Atom C2558
  • Impat of enabling ALTQ on forwarding performance with 4 cores AMD GX-412TC

• Impact of number of static routes:

  • Impact of number of static routes on forwarding performance with 4 cores Xeon L5630

• Mellanox ConnectX-4 tuning:

  • Impact of queue number on forwarding performance with 2x12 cores Xeon E5-2650

• Chelsio NIC T540-CR tuning:

  • Impact of queue number on forwarding performance with 8 cores Xeon E5-2650
  • Impact of queue number on forwarding performance with 8 cores Atom C2758
  • Impact of disabling cxgbe.toecaps_allowed on forwarding performance with 8 cores Xeon E5-2650
  • Impact of pinning IRQ queue to CPU with 8 cores Xeon E5-2650
  • Impact of pinning IRQ queue to CPU with 8 cores Atom C2758

• Intel 82599EB NIC tuning:

  • Impact of Intel 82599EB queue number (1 queue per core) on forwarding performance with 4 cores Xeon L5630
  • Impact of random.harvest.mask and Intel 82599EB queue number (1 queue per core) on forwarding performance with 4 cores Xeon L5630
  • Impact of Intel 82599EB AIM on forwarding performance with 4 cores Xeon L5630
  • Impact of Intel 82599EB Rx|Tx process limit on forwarding performance with 4 cores Xeon L5630
  • Impact of Intel 82599EB descriptors per queue on forwarding performance with 4 cores Xeon L5630
  • Impact of AIM on Intel 82599EB

• Hyper Threading impact:

  • Impact of enabling HT on forwarding performance

• Intel i350 tuning:

  • Impact of Intel i350 number of queues(1 queue per core) on forwarding performance with 4 cores Atom C2558
  • Impact of AIM on Intel i350

• Packet filter (pf) tuning:

  • Impact of states_hashsize table on pf performance on FreeBSD 12-head r332390 on Atom 8 core
  • Impact of states_hashsize table on pf performance on FreeBSD 12-head r332390 on AMD GX
  • Impact of number of flows on pf performance on FreeBSD 11.1-yandex

• ipfw tuning:

  • Impact of number of flows with maximum ipfw hash table on FreeBSD 11.1-yandex

• IPSec performance:

  • IPSec performance with 2 cores AMD G-T40E (PC Engines APU1D)
  • IPSec performance with 4 cores AMD GX-412TC (PC Engines APU2C4)
  • IPSec performance with 4 cores Atom C2558 (Netgate RCC-VE 4860)
  • IPsec performance with 4 cores Intel Xeon L5630 (IBM x3550-M3)

• OpenVPN performance:

  • OpenVPN performance with 2 cores AMD G-T40E (PC Engines APU1D)
  • OpenVPN performance with 4 cores AMD GX-412TC (PC Engines APU2C4)
  • OpenVPN performance with 4 cores Atom C2558 (Netgate RCC-VE 4860)
  • OpenVPN performance with 4 cores Intel Xeon L5630 (IBM x3550-M3)

Synthesis:

• 
• 
•