9 Replies Latest reply on Jun 27, 2016 11:56 PM by Intel Corporation

    X/L710, FreeBSD VF per VF performance

    r2r

      Hello All,

       

      I have 4 port X710 card

       

      [root@localhost vcr]# lsmod | grep i40e

      i40evf                 73728  0

      i40e                  315392  0

      geneve                 28672  1 i40e

      vxlan                  40960  2 i40e,ixgbe

      ptp                    20480  3 igb,i40e,ixgbe

      [root@localhost vcr]# modinfo i40e

      filename:       /lib/modules/4.5.5-201.fc23.x86_64/kernel/drivers/net/ethernet/intel/i40e/i40e.ko.xz

      version:        1.5.16

      license:        GPL

      description:    Intel(R) 40-10 Gigabit Ethernet Connection Network Driver

      author:         Intel Corporation, <e1000-devel@lists.sourceforge.net>

      srcversion:     D50DB0062A90F6C369842D1

      alias:          pci:v00008086d00001588sv*sd*bc*sc*i*

      alias:          pci:v00008086d00001587sv*sd*bc*sc*i*

      alias:          pci:v00008086d00001589sv*sd*bc*sc*i*

      alias:          pci:v00008086d00001586sv*sd*bc*sc*i*

      alias:          pci:v00008086d00001585sv*sd*bc*sc*i*

      alias:          pci:v00008086d00001584sv*sd*bc*sc*i*

      alias:          pci:v00008086d00001583sv*sd*bc*sc*i*

      alias:          pci:v00008086d00001581sv*sd*bc*sc*i*

      alias:          pci:v00008086d00001580sv*sd*bc*sc*i*

      alias:          pci:v00008086d00001574sv*sd*bc*sc*i*

      alias:          pci:v00008086d00001572sv*sd*bc*sc*i*

      depends:        geneve,ptp,vxlan

      vermagic:       4.5.5-201.fc23.x86_64 SMP mod_unload

      parm:           debug:Debug level (0=none,...,16=all) (int)

      [root@localhost vcr]# modinfo i40evf

      filename:       /lib/modules/4.5.5-201.fc23.x86_64/kernel/drivers/net/ethernet/intel/i40evf/i40evf.ko.xz

      version:        1.5.14

      license:        GPL

      description:    Intel(R) 40-10 Gigabit Ethernet Virtual Function Driver

      author:         Intel Corporation, <linux.nics@intel.com>

      srcversion:     522158BAB323575B03D48C8

      alias:          pci:v00008086d0000154Csv*sd*bc*sc*i*

      depends:

      vermagic:       4.5.5-201.fc23.x86_64 SMP mod_unload

      host - fedora 23 kernel 4.5.5

      guest OS is FreeBSD9.3 and VF driver for FreeBSD is 1.2.11(latest).

      ixlv0: <Intel(R) Ethernet Connection XL710 VF Driver, Version - 1.2.11> mem 0xfeb60000-0xfeb6ffff,0xfebe0000-0xfebe3fff at device 9.0 on pci0

      ixlv1: <Intel(R) Ethernet Connection XL710 VF Driver, Version - 1.2.11> mem 0xfeb70000-0xfeb7ffff,0xfebe4000-0xfebe7fff at device 11.0 on pci0

      ixlv2: <Intel(R) Ethernet Connection XL710 VF Driver, Version - 1.2.11> mem 0xfeb80000-0xfeb8ffff,0xfebe8000-0xfebebfff at device 12.0 on pci0

      ixlv3: <Intel(R) Ethernet Connection XL710 VF Driver, Version - 1.2.11> mem 0xfeb90000-0xfeb9ffff,0xfebec000-0xfebeffff at device 13.0 on pci0

      ixlv4: <Intel(R) Ethernet Connection XL710 VF Driver, Version - 1.2.11> mem 0xfeba0000-0xfebaffff,0xfebf0000-0xfebf3fff at device 14.0 on pci0

      ixlv5: <Intel(R) Ethernet Connection XL710 VF Driver, Version - 1.2.11> mem 0xfebb0000-0xfebbffff,0xfebf4000-0xfebf7fff at device 15.0 on pci0

      ixlv6: <Intel(R) Ethernet Connection XL710 VF Driver, Version - 1.2.11> mem 0xfebc0000-0xfebcffff,0xfebf8000-0xfebfbfff at device 16.0 on pci0

      ixlv7: <Intel(R) Ethernet Connection XL710 VF Driver, Version - 1.2.11> mem 0xfebd0000-0xfebdffff,0xfebfc000-0xfebfffff at device 17.0 on pci0

      I have configured 2 ports each with 4 VF so in total i am getting only ~100Mbps which way less than what i get from virtio.

      My performance per VF is ~10Mbps and 4 VFs are getting only 40Mbps/port however i am providing close to 2.5Gbps pcap

       

      Also i have upgraded firmware to latest, 5.04

      [73053.043664] i40e 0000:aa:00.3: fw 5.0.40043 api 1.5 nvm 5.04 0x800024da 0.0.0

       

      is there anything i am doing wrong? What's official/profiled per VF performance in the guest.

       

      Thank you in advance

       

      -chintu-