Ethernet Products
Determine ramifications of Intel® Ethernet products and technologies
4810 Discussions

Improve VMQ/RSS CPU core loadbalancing during traffic spikes

gveld
Novice
2,754 Views

Some of my servers become unresponsive during traffic spikes (e.g. small DoS/DDoS attacks, which do not max out our connection.)

The servers become unresponsive because of high CPU usage, after running some tests I saw that only one core is being utilized for 100% during a <200Mbps packet flood. The server stopped replying to ICMP echo/ping.

I think the pictures explain them self.

On this machine we use VMQ, there are 7 Vport available. But according to the Intel driver only two are actually in use.

 

How can we allow VMQ/network stack on the host OS to use more than 1 core?

We've seen similar issues with servers with RSS load balancing, although the load balancing works better there. (spreads over multiple cores.)

 

Are there any tips to improve RSS load balancing during traffic spikes? We use Intel Xeon E3 systems with 4 cores + Hyper Threading and one Intel Xeon E5 system with 6 cores and Hyper Threading.

We want to keep the server working during traffic spikes and all round keep our latency to the minimum.

0 Kudos
11 Replies
idata
Employee
966 Views

Hi gijs007,

 

 

 

Thank you for the post. Just to double check if you refer to this document about the RSS

 

 

http://www.intel.com/content/www/us/en/support/network-and-i-o/ethernet-products/000006703.html

 

 

As noted "RSS is not supported on some adapters configured to use Virtual Machine Queues (VMQ). On these adapters VMQ will take precedence over RSS. RSS will appear disabled"

 

 

Can you also share what is the exact server system model used here? What is the onboard NIC model?

 

 

 

Thanks,

 

wb

 

0 Kudos
gveld
Novice
966 Views

I use a Supermicro SuperServer 5017C-TF, the onboard NIC model is an Intel® 82574L.

I understand that RSS is being disabled, but shouldn't VMQ still allow the host OS to use more than one core to handle network related tasks?

0 Kudos
idata
Employee
966 Views

Hi gijs007,

 

 

Thank you for the information. Have you also check with Supermicro on the setting as this is an onboard NIC, there could be some setting changed on the NIC when integrated on the system.

 

Please feel free to update me.

 

 

rgds,

 

wb

 

0 Kudos
gveld
Novice
966 Views

The NIC with the issue is an Intel I350-T2.

The onboad nic doesn't even support VMQ.

 

If I were to contact SuperMicro they would tell me they use a network chip made by Intel and that I use drivers made by Intel, so I would need to contact you guys as you wrote this software not them.
0 Kudos
idata
Employee
966 Views

Hi gijs007,

 

 

Thank you for the information. I will try further check for you, the reason we refer you to contact Supermicro is because they might have their customized driver that is best for the onboard NIC.

 

Please refer to http://www.intel.com/content/www/us/en/support/network-and-i-o/ethernet-products/000006628.html?wapkw=oem+network

 

 

rgds,

 

wb

 

0 Kudos
gveld
Novice
966 Views

Still I don't see why that matters, as I'm not using the onboard NIC.

I'm using the separate bought addon card: Intel I350-T2

0 Kudos
idata
Employee
966 Views

Hi gjs007,

 

 

Thank you for the clarification. I will check on this.

 

 

rgds

 

wb

 

0 Kudos
idata
Employee
966 Views

Hi gijs007,

 

Have you tried checking the RSS guide for reference?

 

http://www.intel.com/content/www/us/en/support/network-and-i-o/ethernet-products/000006703.html

 

 

Here are some reference information for performance tuning

 

http://www.intel.com/content/www/us/en/support/network-and-i-o/ethernet-products/000005811.html

 

 

rgds,

 

wb

 

0 Kudos
gveld
Novice
966 Views

RSS is disabled as VMQ takes precedence. I'm trying to make VMQ use more than one core for the host OS.

0 Kudos
idata
Employee
966 Views

Hi gijs007,

 

 

I will check on this.

 

 

rgds,

 

wb

 

0 Kudos
idata
Employee
966 Views

Hi gijs007,

 

 

Good day. Further checking , this is an OS or system issue, you need to seek support from the OS or system vendor.

 

 

Hope the above clarified.

 

 

Thanks,

 

wb

 

0 Kudos
Reply