2 Replies Latest reply on Nov 2, 2011 2:01 PM by mark_h_@intel

    Intel 82576 constant flow issue

    ubxyz

      Hello,
      I have just bought an Intel Gigabit ET2 Quad Port Svr adapter (known as Intel 82576(GB)).

       

       


      In order to get the best out of my card, i've compiled and inserted the last version of the igb module provided by intel (igb-3.2.10) on ubuntu 10.04 LTS. Because the original module in ubuntu 10.04 (version 2.1.0-k2) does not recognized the card and therefore not all options are available !
      Compilation and insertion of the module were done without any problem.
      The different options for this card are recognized by the module (igb-3.2.10) which shows, opposed to the built-in module version (2.1.0-k2), that the card is correctly recognized.

       

       


      My problem is the following:
      When sending a constant flow using tcpreplay for example the card is not sending a constant flow but short burst of packets every half a second as if the card is not able to handle a constant flow. Problem has been identified by watching the output of /proc/net/dev.

       

       


      I have to precise that I have tested the last driver version (igb-3.2.10) on ubuntu 11.10 too and that the result were the same as for ubuntu 10.04 LTS !
      Moreover I have tested older version of the driver resulting always to the same issue.
      I have also tested different packet rates that shows that it is not related to the packet rate (10pps, 100pps, ...) and different packet sizes.

       

       


      The following elements are displayed at the end of this message:
      * lspci -vvvv outputs (from ubuntu 11.10 and ubuntu 10.04)
      * modinfo on igb 3.2.10 (ub 10.04)
      * dmesg on inserting the igb 3.2.10 module (ub 10.04)

       

       


      Some more precisions:
      The card firmware as shown by ethtool -i <interface> is listed as 1.2.1.
      The card is not recognized in lspci under ubuntu 10.04 as shown below:
      03:00.0 Ethernet controller: Intel Corporation Device 1526 (rev 01)
      03:00.1 Ethernet controller: Intel Corporation Device 1526 (rev 01)
      04:00.0 Ethernet controller: Intel Corporation Device 1526 (rev 01)
      04:00.1 Ethernet controller: Intel Corporation Device 1526 (rev 01)
      Although it is recognized under ubuntu 11.10:
      03:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
      03:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
      04:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
      04:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)

       

       


      Would it be possible that a firmware update would solve the issue ? If yes were do i find a new firmware for this type of card and how do i update it.
      I would be very grateful if anyone could give me any advice or direction on how to solve/identify the problem.
      Thank you !

       

       

       

      ************************************ lspci -vvv on ubuntu 10.04 ************************************************
      03:00.0 Ethernet controller: Intel Corporation Device 1526 (rev 01)
          Subsystem: Intel Corporation Device a06c
          Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
          Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
          Latency: 0, Cache Line Size: 64 bytes
          Interrupt: pin A routed to IRQ 18
          Region 0: Memory at fe8c0000 (32-bit, non-prefetchable) [size=128K]
          Region 1: Memory at fe000000 (32-bit, non-prefetchable) [size=4M]
          Region 2: I/O ports at dcc0 [size=32]
          Region 3: Memory at fe8b8000 (32-bit, non-prefetchable) [size=16K]
          Capabilities: <access denied>
          Kernel driver in use: igb
          Kernel modules: igb

      03:00.1 Ethernet controller: Intel Corporation Device 1526 (rev 01)
          Subsystem: Intel Corporation Device a06c
          Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
          Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
          Latency: 0, Cache Line Size: 64 bytes
          Interrupt: pin B routed to IRQ 19
          Region 0: Memory at fe8e0000 (32-bit, non-prefetchable) [size=128K]
          Region 1: Memory at fe400000 (32-bit, non-prefetchable) [size=4M]
          Region 2: I/O ports at dce0 [size=32]
          Region 3: Memory at fe8bc000 (32-bit, non-prefetchable) [size=16K]
          Capabilities: <access denied>
          Kernel driver in use: igb
          Kernel modules: igb

      04:00.0 Ethernet controller: Intel Corporation Device 1526 (rev 01)
          Subsystem: Intel Corporation Device a06c
          Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
          Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
          Latency: 0, Cache Line Size: 64 bytes
          Interrupt: pin A routed to IRQ 16
          Region 0: Memory at fd7c0000 (32-bit, non-prefetchable) [size=128K]
          Region 1: Memory at fd800000 (32-bit, non-prefetchable) [size=4M]
          Region 2: I/O ports at ccc0 [size=32]
          Region 3: Memory at fd7b8000 (32-bit, non-prefetchable) [size=16K]
          Capabilities: <access denied>
          Kernel driver in use: igb
          Kernel modules: igb

      04:00.1 Ethernet controller: Intel Corporation Device 1526 (rev 01)
          Subsystem: Intel Corporation Device a06c
          Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
          Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
          Latency: 0, Cache Line Size: 64 bytes
          Interrupt: pin B routed to IRQ 17
          Region 0: Memory at fd7e0000 (32-bit, non-prefetchable) [size=128K]
          Region 1: Memory at fdc00000 (32-bit, non-prefetchable) [size=4M]
          Region 2: I/O ports at cce0 [size=32]
          Region 3: Memory at fd7bc000 (32-bit, non-prefetchable) [size=16K]
          Capabilities: <access denied>
          Kernel driver in use: igb
          Kernel modules: igb


      ************************************ lspci -vvv on ubuntu 11.10 ************************************************
      03:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
          Subsystem: Intel Corporation Gigabit ET2 Quad Port Server Adapter
          Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
          Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
          Latency: 0, Cache Line Size: 64 bytes
          Interrupt: pin A routed to IRQ 18
          Region 0: Memory at fe8c0000 (32-bit, non-prefetchable) [size=128K]
          Region 1: Memory at fe000000 (32-bit, non-prefetchable) [size=4M]
          Region 2: I/O ports at dcc0 [size=32]
          Region 3: Memory at fe8b8000 (32-bit, non-prefetchable) [size=16K]
          Capabilities: [40] Power Management version 3
              Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
              Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
          Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
              Address: 0000000000000000  Data: 0000
              Masking: 00000000  Pending: 00000000
          Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
              Vector table: BAR=3 offset=00000000
              PBA: BAR=3 offset=00002000
          Capabilities: [a0] Express (v2) Endpoint, MSI 00
              DevCap:    MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                  ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
              DevCtl:    Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                  RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
                  MaxPayload 128 bytes, MaxReadReq 512 bytes
              DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
              LnkCap:    Port #2, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 <4us, L1 <64us
                  ClockPM- Surprise- LLActRep- BwNot-
              LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
                  ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
              LnkSta:    Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
              DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
              DevCtl2: Completion Timeout: 16ms to 55ms, TimeoutDis-
              LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                   Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                   Compliance De-emphasis: -6dB
              LnkSta2: Current De-emphasis Level: -6dB
          Capabilities: [100 v1] Advanced Error Reporting
              UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
              UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
              UESvrt:    DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
              CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
              CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
              AERCap:    First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
          Capabilities: [140 v1] Device Serial Number 00-1b-21-ff-ff-b7-91-24
          Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
              ARICap:    MFVC- ACS-, Next Function: 1
              ARICtl:    MFVC- ACS-, Function Group: 0
          Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
              IOVCap:    Migration-, Interrupt Message Number: 000
              IOVCtl:    Enable- Migration- Interrupt- MSE- ARIHierarchy-
              IOVSta:    Migration-
              Initial VFs: 8, Total VFs: 8, Number of VFs: 8, Function Dependency Link: 00
              VF offset: 384, stride: 2, Device ID: 10ca
              Supported Page Size: 00000553, System Page Size: 00000001
              Region 0: Memory at 00000000f0000000 (64-bit, prefetchable)
              Region 3: Memory at 00000000f0020000 (64-bit, prefetchable)
              VF Migration: offset: 00000000, BIR: 0
          Kernel driver in use: igb
          Kernel modules: igb

      03:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
          Subsystem: Intel Corporation Gigabit ET2 Quad Port Server Adapter
          Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
          Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
          Latency: 0, Cache Line Size: 64 bytes
          Interrupt: pin B routed to IRQ 19
          Region 0: Memory at fe8e0000 (32-bit, non-prefetchable) [size=128K]
          Region 1: Memory at fe400000 (32-bit, non-prefetchable) [size=4M]
          Region 2: I/O ports at dce0 [size=32]
          Region 3: Memory at fe8bc000 (32-bit, non-prefetchable) [size=16K]
          Capabilities: [40] Power Management version 3
              Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
              Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
          Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
              Address: 0000000000000000  Data: 0000
              Masking: 00000000  Pending: 00000000
          Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
              Vector table: BAR=3 offset=00000000
              PBA: BAR=3 offset=00002000
          Capabilities: [a0] Express (v2) Endpoint, MSI 00
              DevCap:    MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                  ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
              DevCtl:    Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                  RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
                  MaxPayload 128 bytes, MaxReadReq 512 bytes
              DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
              LnkCap:    Port #2, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 <4us, L1 <64us
                  ClockPM- Surprise- LLActRep- BwNot-
              LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
                  ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
              LnkSta:    Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
              DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
              DevCtl2: Completion Timeout: 16ms to 55ms, TimeoutDis-
              LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                   Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                   Compliance De-emphasis: -6dB
              LnkSta2: Current De-emphasis Level: -6dB
          Capabilities: [100 v1] Advanced Error Reporting
              UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
              UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
              UESvrt:    DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
              CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
              CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
              AERCap:    First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
          Capabilities: [140 v1] Device Serial Number 00-1b-21-ff-ff-b7-91-24
          Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
              ARICap:    MFVC- ACS-, Next Function: 0
              ARICtl:    MFVC- ACS-, Function Group: 0
          Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
              IOVCap:    Migration-, Interrupt Message Number: 000
              IOVCtl:    Enable- Migration- Interrupt- MSE- ARIHierarchy-
              IOVSta:    Migration-
              Initial VFs: 8, Total VFs: 8, Number of VFs: 8, Function Dependency Link: 01
              VF offset: 384, stride: 2, Device ID: 10ca
              Supported Page Size: 00000553, System Page Size: 00000001
              Region 0: Memory at 00000000f0040000 (64-bit, prefetchable)
              Region 3: Memory at 00000000f0060000 (64-bit, prefetchable)
              VF Migration: offset: 00000000, BIR: 0
          Kernel driver in use: igb
          Kernel modules: igb

      04:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
          Subsystem: Intel Corporation Gigabit ET2 Quad Port Server Adapter
          Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
          Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
          Latency: 0, Cache Line Size: 64 bytes
          Interrupt: pin A routed to IRQ 16
          Region 0: Memory at fd7c0000 (32-bit, non-prefetchable) [size=128K]
          Region 1: Memory at fd800000 (32-bit, non-prefetchable) [size=4M]
          Region 2: I/O ports at ccc0 [size=32]
          Region 3: Memory at fd7b8000 (32-bit, non-prefetchable) [size=16K]
          Capabilities: [40] Power Management version 3
              Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
              Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
          Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
              Address: 0000000000000000  Data: 0000
              Masking: 00000000  Pending: 00000000
          Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
              Vector table: BAR=3 offset=00000000
              PBA: BAR=3 offset=00002000
          Capabilities: [a0] Express (v2) Endpoint, MSI 00
              DevCap:    MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                  ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
              DevCtl:    Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                  RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
                  MaxPayload 128 bytes, MaxReadReq 512 bytes
              DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
              LnkCap:    Port #4, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 <4us, L1 <64us
                  ClockPM- Surprise- LLActRep- BwNot-
              LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
                  ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
              LnkSta:    Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
              DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
              DevCtl2: Completion Timeout: 16ms to 55ms, TimeoutDis-
              LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                   Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                   Compliance De-emphasis: -6dB
              LnkSta2: Current De-emphasis Level: -6dB
          Capabilities: [100 v1] Advanced Error Reporting
              UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
              UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
              UESvrt:    DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
              CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
              CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
              AERCap:    First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
          Capabilities: [140 v1] Device Serial Number 00-1b-21-ff-ff-b7-91-26
          Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
              ARICap:    MFVC- ACS-, Next Function: 1
              ARICtl:    MFVC- ACS-, Function Group: 0
          Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
              IOVCap:    Migration-, Interrupt Message Number: 000
              IOVCtl:    Enable- Migration- Interrupt- MSE- ARIHierarchy-
              IOVSta:    Migration-
              Initial VFs: 8, Total VFs: 8, Number of VFs: 8, Function Dependency Link: 00
              VF offset: 384, stride: 2, Device ID: 10ca
              Supported Page Size: 00000553, System Page Size: 00000001
              Region 0: Memory at 00000000f0100000 (64-bit, prefetchable)
              Region 3: Memory at 00000000f0120000 (64-bit, prefetchable)
              VF Migration: offset: 00000000, BIR: 0
          Kernel driver in use: igb
          Kernel modules: igb

      04:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
          Subsystem: Intel Corporation Gigabit ET2 Quad Port Server Adapter
          Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
          Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
          Latency: 0, Cache Line Size: 64 bytes
          Interrupt: pin B routed to IRQ 17
          Region 0: Memory at fd7e0000 (32-bit, non-prefetchable) [size=128K]
          Region 1: Memory at fdc00000 (32-bit, non-prefetchable) [size=4M]
          Region 2: I/O ports at cce0 [size=32]
          Region 3: Memory at fd7bc000 (32-bit, non-prefetchable) [size=16K]
          Capabilities: [40] Power Management version 3
              Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
              Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
          Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
              Address: 0000000000000000  Data: 0000
              Masking: 00000000  Pending: 00000000
          Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
              Vector table: BAR=3 offset=00000000
              PBA: BAR=3 offset=00002000
          Capabilities: [a0] Express (v2) Endpoint, MSI 00
              DevCap:    MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                  ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
              DevCtl:    Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                  RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
                  MaxPayload 128 bytes, MaxReadReq 512 bytes
              DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
              LnkCap:    Port #4, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 <4us, L1 <64us
                  ClockPM- Surprise- LLActRep- BwNot-
              LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
                  ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
              LnkSta:    Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
              DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
              DevCtl2: Completion Timeout: 16ms to 55ms, TimeoutDis-
              LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                   Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                   Compliance De-emphasis: -6dB
              LnkSta2: Current De-emphasis Level: -6dB
          Capabilities: [100 v1] Advanced Error Reporting
              UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
              UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
              UESvrt:    DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
              CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
              CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
              AERCap:    First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
          Capabilities: [140 v1] Device Serial Number 00-1b-21-ff-ff-b7-91-26
          Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
              ARICap:    MFVC- ACS-, Next Function: 0
              ARICtl:    MFVC- ACS-, Function Group: 0
          Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
              IOVCap:    Migration-, Interrupt Message Number: 000
              IOVCtl:    Enable- Migration- Interrupt- MSE- ARIHierarchy-
              IOVSta:    Migration-
              Initial VFs: 8, Total VFs: 8, Number of VFs: 8, Function Dependency Link: 01
              VF offset: 384, stride: 2, Device ID: 10ca
              Supported Page Size: 00000553, System Page Size: 00000001
              Region 0: Memory at 00000000f0140000 (64-bit, prefetchable)
              Region 3: Memory at 00000000f0160000 (64-bit, prefetchable)
              VF Migration: offset: 00000000, BIR: 0
          Kernel driver in use: igb
          Kernel modules: igb


      ************************************ modinfo igb-3.2.10 on ubuntu 10.04 ************************************************
      filename:       /home/tm/Downloads/intel/igb/igb-3.2.10/src/igb.ko
      version:        3.2.10
      license:        GPL
      description:    Intel(R) Gigabit Ethernet Network Driver
      author:         Intel Corporation, <e1000-devel@lists.sourceforge.net>
      srcversion:     BAAD5948059DD794C854151
      alias:          pci:v00008086d000010D6sv*sd*bc*sc*i*
      alias:          pci:v00008086d000010A9sv*sd*bc*sc*i*
      alias:          pci:v00008086d000010A7sv*sd*bc*sc*i*
      alias:          pci:v00008086d000010E8sv*sd*bc*sc*i*
      alias:          pci:v00008086d00001526sv*sd*bc*sc*i*
      alias:          pci:v00008086d0000150Dsv*sd*bc*sc*i*
      alias:          pci:v00008086d000010E7sv*sd*bc*sc*i*
      alias:          pci:v00008086d000010E6sv*sd*bc*sc*i*
      alias:          pci:v00008086d00001518sv*sd*bc*sc*i*
      alias:          pci:v00008086d0000150Asv*sd*bc*sc*i*
      alias:          pci:v00008086d000010C9sv*sd*bc*sc*i*
      alias:          pci:v00008086d00000440sv*sd*bc*sc*i*
      alias:          pci:v00008086d0000043Csv*sd*bc*sc*i*
      alias:          pci:v00008086d0000043Asv*sd*bc*sc*i*
      alias:          pci:v00008086d00000438sv*sd*bc*sc*i*
      alias:          pci:v00008086d00001516sv*sd*bc*sc*i*
      alias:          pci:v00008086d00001511sv*sd*bc*sc*i*
      alias:          pci:v00008086d00001510sv*sd*bc*sc*i*
      alias:          pci:v00008086d00001527sv*sd*bc*sc*i*
      alias:          pci:v00008086d0000150Fsv*sd*bc*sc*i*
      alias:          pci:v00008086d0000150Esv*sd*bc*sc*i*
      alias:          pci:v00008086d00001524sv*sd*bc*sc*i*
      alias:          pci:v00008086d00001523sv*sd*bc*sc*i*
      alias:          pci:v00008086d00001522sv*sd*bc*sc*i*
      alias:          pci:v00008086d00001521sv*sd*bc*sc*i*
      depends:        dca
      vermagic:       3.0.0-0300-generic SMP mod_unload modversions 686
      parm:           InterruptThrottleRate:Maximum interrupts per second, per vector, (max 100000), default 3=adaptive (array of int)
      parm:           IntMode:Change Interrupt Mode (0=Legacy, 1=MSI, 2=MSI-X), default 2 (array of int)
      parm:           Node:set the starting node to allocate memory on, default -1 (array of int)
      parm:           LLIPort:Low Latency Interrupt TCP Port (0-65535), default 0=off (array of int)
      parm:           LLIPush:Low Latency Interrupt on TCP Push flag (0,1), default 0=off (array of int)
      parm:           LLISize:Low Latency Interrupt on Packet Size (0-1500), default 0=off (array of int)
      parm:           RSS:Number of Receive-Side Scaling Descriptor Queues (0-8), default 1=number of cpus (array of int)
      parm:           VMDQ:Number of Virtual Machine Device Queues: 0-1 = disable, 2-8 enable, default 0 (array of int)
      parm:           max_vfs:Number of Virtual Functions: 0 = disable, 1-7 enable, default 0 (array of int)
      parm:           MDD:Malicious Driver Detection (0/1), default 1 = enabled. Only available when max_vfs is greater than 0 (array of int)
      parm:           QueuePairs:Enable TX/RX queue pairs for interrupt handling (0,1), default 1=on (array of int)
      parm:           EEE:Enable/disable on parts that support the feature (array of int)
      parm:           DMAC:Disable or set latency for DMA Coalescing ((0=off, 1000-10000(msec), 250, 500 (usec)) (array of int)
      parm:           LRO:Large Receive Offload (0,1), default 0=off (array of int)
      parm:           debug:Debug level (0=none, ..., 16=all) (int)


      ************************************ dmesg modprobe igb-3.2.10 on ubuntu 10.04 ************************************************

      [  603.828875] Intel(R) Gigabit Ethernet Network Driver - version 3.2.10
      [  603.828878] Copyright (c) 2007-2011 Intel Corporation.
      [  603.828925] igb 0000:03:00.0: PCI INT A -> GSI 18 (level, low) -> IRQ 18
      [  603.828946] igb 0000:03:00.0: setting latency timer to 64
      [  603.829285] igb 0000:03:00.0: irq 44 for MSI/MSI-X
      [  603.829293] igb 0000:03:00.0: irq 45 for MSI/MSI-X
      [  604.053030] igb 0000:03:00.0: Intel(R) Gigabit Ethernet Network Connection
      [  604.053034] igb 0000:03:00.0: eth1: (PCIe:2.5GT/s:Width x4
      [  604.053036] )
      [  604.053038] igb 0000:03:00.0: eth1: MAC: 00:1b:21:b7:91:24
      [  604.053125] igb 0000:03:00.0: eth1: PBA No: E91609-003
      [  604.053128] igb 0000:03:00.0: LRO is disabled
      [  604.053131] igb 0000:03:00.0: Using MSI-X interrupts. 1 rx queue(s), 1 tx queue(s)
      [  604.053259] igb 0000:03:00.1: PCI INT B -> GSI 19 (level, low) -> IRQ 19
      [  604.053279] igb 0000:03:00.1: setting latency timer to 64
      [  604.053594] igb 0000:03:00.1: irq 46 for MSI/MSI-X
      [  604.053602] igb 0000:03:00.1: irq 47 for MSI/MSI-X
      [  604.259669] ADDRCONF(NETDEV_UP): eth1: link is not ready
      [  604.261555] igb 0000:03:00.1: Intel(R) Gigabit Ethernet Network Connection
      [  604.261559] igb 0000:03:00.1: eth2: (PCIe:2.5GT/s:Width x4
      [  604.261560] )
      [  604.261561] igb 0000:03:00.1: eth2: MAC: 00:1b:21:b7:91:25
      [  604.261647] igb 0000:03:00.1: eth2: PBA No: E91609-003
      [  604.261649] igb 0000:03:00.1: LRO is disabled
      [  604.261651] igb 0000:03:00.1: Using MSI-X interrupts. 1 rx queue(s), 1 tx queue(s)
      [  604.261754] igb 0000:04:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
      [  604.261773] igb 0000:04:00.0: setting latency timer to 64
      [  604.262075] igb 0000:04:00.0: irq 48 for MSI/MSI-X
      [  604.262080] igb 0000:04:00.0: irq 51 for MSI/MSI-X
      [  604.453124] ADDRCONF(NETDEV_UP): eth2: link is not ready
      [  604.485063] igb 0000:04:00.0: Intel(R) Gigabit Ethernet Network Connection
      [  604.485068] igb 0000:04:00.0: eth3: (PCIe:2.5GT/s:Width x4
      [  604.485069] )
      [  604.485071] igb 0000:04:00.0: eth3: MAC: 00:1b:21:b7:91:26
      [  604.485158] igb 0000:04:00.0: eth3: PBA No: E91609-003
      [  604.485161] igb 0000:04:00.0: LRO is disabled
      [  604.485164] igb 0000:04:00.0: Using MSI-X interrupts. 1 rx queue(s), 1 tx queue(s)
      [  604.485188] igb 0000:04:00.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
      [  604.485207] igb 0000:04:00.1: setting latency timer to 64
      [  604.485531] igb 0000:04:00.1: irq 52 for MSI/MSI-X
      [  604.485538] igb 0000:04:00.1: irq 53 for MSI/MSI-X
      [  604.689176] ADDRCONF(NETDEV_UP): eth3: link is not ready
      [  604.692852] igb 0000:04:00.1: Intel(R) Gigabit Ethernet Network Connection
      [  604.692855] igb 0000:04:00.1: eth4: (PCIe:2.5GT/s:Width x4
      [  604.692857] )
      [  604.692858] igb 0000:04:00.1: eth4: MAC: 00:1b:21:b7:91:27
      [  604.692944] igb 0000:04:00.1: eth4: PBA No: E91609-003
      [  604.692946] igb 0000:04:00.1: LRO is disabled
      [  604.692948] igb 0000:04:00.1: Using MSI-X interrupts. 1 rx queue(s), 1 tx queue(s)
      [  604.889121] ADDRCONF(NETDEV_UP): eth4: link is not ready
      [  606.372523] igb: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
      [  606.372836] ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
      [  607.048515] igb: eth4 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
      [  607.048828] ADDRCONF(NETDEV_CHANGE): eth4: link becomes ready
      [  617.152011] eth1: no IPv6 routers present
      [  617.584013] eth4: no IPv6 routers present