5 Replies Latest reply on Sep 12, 2018 6:36 PM by Intel Corporation

    Issues with the SFP+ ports on a D-1537 SOC (Supermicro X10SDV-7TP4F) with linux

    kbrowder

      I'm going into a XS512EM and I've tried the AXM761 compatible DACs from 10Gtek, as well as a Cable Matters DAC with general support.  I'm on Fedora 28 with ixgbe 5.1.0-k and what happens is once connected the DAC is attached it very quickly cycles through link down and link up.  I'm kindof suspecting it's still a cabling issue since SFP+ implementations are generally bad (in comparison to 10GBase-T) but i'm not sure.  I've also tried a recent Ubuntu and it had the same issues.

       

      From journalctl -xe

      May 08 18:55:02 myhost kernel: ixgbe 0000:04:00.1 eno8: detected SFP+: 4

      May 08 18:55:02 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:02 myhost kernel: IPv6: ADDRCONF(NETDEV_CHANGE): eno8: link becomes ready

      May 08 18:55:02 myhost NetworkManager[1049]: <info>  [1525820102.6709] device (eno8): carrier: link connected

      May 08 18:55:02 myhost NetworkManager[1049]: <info>  [1525820102.6733] device (eno8): state change: unavailable -> disconnected (reason 'carrier-changed', sys-iface-state: 'managed')

      May 08 18:55:02 myhost NetworkManager[1049]: <info>  [1525820102.6757] policy: auto-activating connection 'eno8'

      May 08 18:55:02 myhost NetworkManager[1049]: <info>  [1525820102.6780] device (eno8): Activation: starting connection 'eno8' (adddd43a-d127-3c9e-8408-e2eeade7a7db)

      May 08 18:55:02 myhost NetworkManager[1049]: <info>  [1525820102.6787] device (eno8): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')

      May 08 18:55:02 myhost NetworkManager[1049]: <info>  [1525820102.6797] device (eno8): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')

      May 08 18:55:02 myhost NetworkManager[1049]: <info>  [1525820102.6806] device (eno8): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')

      May 08 18:55:02 myhost NetworkManager[1049]: <info>  [1525820102.6811] dhcp4 (eno8): activation: beginning transaction (timeout in 45 seconds)

      May 08 18:55:02 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:02 myhost NetworkManager[1049]: <info>  [1525820102.6848] dhcp4 (eno8): dhclient started with pid 2167

      May 08 18:55:02 myhost dhclient[2167]: DHCPDISCOVER on eno8 to 255.255.255.255 port 67 interval 6 (xid=0x3e168505)

      May 08 18:55:05 myhost NetworkManager[1049]: <info>  [1525820105.2694] device (eno8): carrier: link connected

      May 08 18:55:05 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:05 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:06 myhost NetworkManager[1049]: <info>  [1525820106.6215] device (eno8): carrier: link connected

      May 08 18:55:06 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:06 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:08 myhost dhclient[2167]: DHCPDISCOVER on eno8 to 255.255.255.255 port 67 interval 6 (xid=0x3e168505)

      May 08 18:55:09 myhost NetworkManager[1049]: <info>  [1525820109.8454] device (eno8): carrier: link connected

      May 08 18:55:09 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:09 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:10 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:10 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:12 myhost NetworkManager[1049]: <info>  [1525820112.1334] device (eno8): carrier: link connected

      May 08 18:55:12 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:12 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:14 myhost dhclient[2167]: DHCPDISCOVER on eno8 to 255.255.255.255 port 67 interval 11 (xid=0x3e168505)

      May 08 18:55:14 myhost NetworkManager[1049]: <info>  [1525820114.4214] device (eno8): carrier: link connected

      May 08 18:55:14 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:14 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:16 myhost NetworkManager[1049]: <info>  [1525820116.0876] device (eno8): carrier: link connected

      May 08 18:55:16 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:16 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:18 myhost NetworkManager[1049]: <info>  [1525820118.7916] device (eno8): carrier: link connected

      May 08 18:55:18 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:18 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:20 myhost NetworkManager[1049]: <info>  [1525820120.4555] device (eno8): carrier: link connected

      May 08 18:55:20 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:20 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:20 myhost NetworkManager[1049]: <info>  [1525820120.8715] device (eno8): carrier: link connected

      May 08 18:55:20 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:20 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:22 myhost NetworkManager[1049]: <info>  [1525820122.2234] device (eno8): carrier: link connected

      May 08 18:55:22 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:22 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      May 08 18:55:23 myhost NetworkManager[1049]: <info>  [1525820123.5754] device (eno8): carrier: link connected

      May 08 18:55:23 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      May 08 18:55:23 myhost kernel: ixgbe 0000:04:00.1 eno8: NIC Link is Down

      Dmesg is much the same as above.

       

      Also:

       

      lspci | grep Eth

      04:00.0 Ethernet controller: Intel Corporation Ethernet Connection X552 10 GbE SFP+

      04:00.1 Ethernet controller: Intel Corporation Ethernet Connection X552 10 GbE SFP+