8 Replies Latest reply on Mar 26, 2012 1:52 PM by Patrick_Kutch

    Help! Stymied by ixgbe broken interaction with iproute2...

    scoph

      When loading the module ixgbe with sr-iov enabled (max_vfs), I  cannot see the relevant interfaces with the iproute utility. This is  required functionality in order to assign a static MAC address to each  VF which are otherwise randomly generated on reboot.

       

      Any suggestions would be greatly appreciated!

       

      Some  data points:
      • Server Information
        • Manufacturer: HP
        • Product Name: ProLiant DL165 G7
      • Ethernet Card Information:
        • Intel Corporation 82599EB 10-Gigabit SFI/SFP+
      • uname:
        • Linux 3.0.0-16-server x86_64 GNU/Linux
      • OS Release:
        • Ubuntu 11.10

       

      Steps to reproduce:

      1. Determine the ethernet interface assignments:

      # dmesg |grep ixgbe\ 0000:05:00.[0-9].*detected|head -n 2
      [    8.448031] ixgbe 0000:05:00.0: eth4: detected SFP+: 5
      [    8.816035] ixgbe 0000:05:00.1: eth5: detected SFP+: 6

       

      2. Load the module without sr-iov enabled (i.e. no max_vfs) and see that the interfaces are visible:

      # modprobe ixgbe

      # ip link show|grep eth[45]
           14: eth4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
           15: eth5: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000

       

      3. Unload the module and reload with sr-iov enabled

      # rmmod ixgbe
      # modprobe ixgbe max_vfs=63
      # ip link show|grep eth[45]
        <<null output!>>

       

      Troubleshooting Steps:

       

      • /proc/net/dev shows my devices exist at all times

      # cat /proc/net/dev|grep eth[45]| cut -d : -f 1
        eth4
        eth5

       

      • configuring the interface via ifconfig is consistent at all times

      # ifconfig eth5 10.0.0.1/24
      # ifconfig eth5
      eth5      Link encap:Ethernet  HWaddr 00:1b:21:b9:a5:e5 
                inet addr:10.0.0.1  Bcast:10.0.0.255  Mask:255.255.255.0

       

      • Tested with the built in as well as self-compiled latest stable releases of ixgbe and iproute2

      # modinfo ixgbe
      filename:       /lib/modules/3.0.0-16-server/kernel/drivers/net/ixgbe/ixgbe.ko
      version:        3.8.21-NAPI
      license:        GPL
      description:    Intel(R) 10 Gigabit PCI Express Network Driver
      author:         Intel Corporation, <linux.nics@intel.com>
      srcversion:     06E123F39C1AAB9CE66E411

      # ip -V
      ip utility, iproute2-ss110317