1 2 Previous Next 15 Replies Latest reply on Jan 2, 2018 7:27 PM by Intel Corporation

    vxlan: non-ECT with TOS=0x02 logs were generated

    woobee

      Hi

       

      I use intel 1G and 10G ethernet card with openvswitch under vxlan overlay network.

      Some VM started to use ECN and I found weird logs were generated about non-ECT.

       

      I checked vxlan packets, but all packets had no errors. Also, vxlan outer header's ECN was normal acording to RFC6040.

       

      I changed ethernet card to Broadcom, and I found there was no non-ECT log.

      I need to stop wrong non-ECT logs. How should I do?

       

      Please see below informations:

       

      [root@compute01 ~]# grep vxlan /var/log/messages | tail

      Dec 13 10:32:57 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 13 10:32:57 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 13 10:32:57 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 13 10:32:57 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 13 10:32:57 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 13 10:32:57 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 13 10:32:57 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 13 10:32:57 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 13 10:33:32 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 13 10:33:34 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

       

      [root@compute01 ~]# uname -a

      Linux compute01 3.10.0-693.5.2.el7.x86_64 #1 SMP Fri Oct 20 20:32:50 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

      [root@compute01 ~]# ethtool -i eth4

      driver: ixgbe

      version: 4.4.0-k-rh7.4

      firmware-version: 0x80000609

      expansion-rom-version:

      bus-info: 0000:04:00.0

      supports-statistics: yes

      supports-test: yes

      supports-eeprom-access: yes

      supports-register-dump: yes

      supports-priv-flags: no

      [root@compute01 ~]# ethtool -k eth4

      Features for eth4:

      rx-checksumming: on

      tx-checksumming: on

              tx-checksum-ipv4: off [fixed]

              tx-checksum-ip-generic: on

              tx-checksum-ipv6: off [fixed]

              tx-checksum-fcoe-crc: on [fixed]

              tx-checksum-sctp: on

      scatter-gather: on

              tx-scatter-gather: on

              tx-scatter-gather-fraglist: off [fixed]

      tcp-segmentation-offload: on

              tx-tcp-segmentation: on

              tx-tcp-ecn-segmentation: off [fixed]

              tx-tcp6-segmentation: on

              tx-tcp-mangleid-segmentation: off

      udp-fragmentation-offload: off [fixed]

      generic-segmentation-offload: on

      generic-receive-offload: on

      large-receive-offload: off

      rx-vlan-offload: on

      tx-vlan-offload: on

      ntuple-filters: off

      receive-hashing: on

      highdma: on [fixed]

      rx-vlan-filter: on

      vlan-challenged: off [fixed]

      tx-lockless: off [fixed]

      netns-local: off [fixed]

      tx-gso-robust: off [fixed]

      tx-fcoe-segmentation: on [fixed]

      tx-gre-segmentation: on

      tx-ipip-segmentation: on

      tx-sit-segmentation: on

      tx-udp_tnl-segmentation: on

      tx-mpls-segmentation: off [fixed]

      fcoe-mtu: off [fixed]

      tx-nocache-copy: off

      loopback: off [fixed]

      rx-fcs: off [fixed]

      rx-all: off

      tx-vlan-stag-hw-insert: off [fixed]

      rx-vlan-stag-hw-parse: off [fixed]

      rx-vlan-stag-filter: off [fixed]

      busy-poll: on [fixed]

      tx-gre-csum-segmentation: on

      tx-udp_tnl-csum-segmentation: on

      tx-gso-partial: on

      tx-sctp-segmentation: off [fixed]

      l2-fwd-offload: off

      hw-tc-offload: off [fixed]

       

       

       

      ///////////////////////////////////////////////////////////////////

      root@oscompute01:~# grep vxlan /var/log/syslog | tail 

      Dec 13 18:53:50 oscompute01 kernel: [188924.432135] vxlan: non-ECT from 192.168.2.32 with TOS=0x2

      Dec 13 18:53:51 oscompute01 kernel: [188925.431957] vxlan: non-ECT from 192.168.2.32 with TOS=0x2

      Dec 13 18:53:51 oscompute01 kernel: [188925.432004] vxlan: non-ECT from 192.168.2.32 with TOS=0x2

      Dec 13 18:53:51 oscompute01 kernel: [188925.447808] vxlan: non-ECT from 192.168.2.32 with TOS=0x2

      Dec 13 18:53:52 oscompute01 kernel: [188926.447743] vxlan: non-ECT from 192.168.2.32 with TOS=0x2

      Dec 13 18:53:52 oscompute01 kernel: [188926.463339] vxlan: non-ECT from 192.168.2.32 with TOS=0x2

      Dec 13 18:53:54 oscompute01 kernel: [188928.463280] vxlan: non-ECT from 192.168.2.32 with TOS=0x2

      Dec 13 18:53:54 oscompute01 kernel: [188928.478883] vxlan: non-ECT from 192.168.2.32 with TOS=0x2

      Dec 13 18:53:55 oscompute01 kernel: [188929.463051] vxlan: non-ECT from 192.168.2.32 with TOS=0x2

      Dec 13 18:53:55 oscompute01 kernel: [188929.478835] vxlan: non-ECT from 192.168.2.32 with TOS=0x2

      root@oscompute01:~# uname -a

      Linux oscompute01 4.4.0-103-generic #126-Ubuntu SMP Mon Dec 4 16:23:28 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

      root@oscompute01:~# ethtool -i eth1

      driver: igb

      version: 5.3.5.12

      firmware-version: 1.70, 0x80000f44, 1.1752.0

      expansion-rom-version:

      bus-info: 0000:04:00.1

      supports-statistics: yes

      supports-test: yes

      supports-eeprom-access: yes

      supports-register-dump: yes

      supports-priv-flags: no

      root@oscompute01:~# ethtool -k eth1

      Features for eth1:

      rx-checksumming: on

      tx-checksumming: on

      tx-checksum-ipv4: on
      tx-checksum-ip-generic: off [fixed]
      tx-checksum-ipv6: on
      tx-checksum-fcoe-crc: off [fixed]
      tx-checksum-sctp: off [fixed]

      scatter-gather: on

      tx-scatter-gather: on
      tx-scatter-gather-fraglist: off [fixed]

      tcp-segmentation-offload: on

      tx-tcp-segmentation: on
      tx-tcp-ecn-segmentation: off [fixed]
      tx-tcp6-segmentation: on

      udp-fragmentation-offload: off [fixed]

      generic-segmentation-offload: on

      generic-receive-offload: on

      large-receive-offload: off [requested on]

      rx-vlan-offload: on

      tx-vlan-offload: on

      ntuple-filters: off [fixed]

      receive-hashing: on

      highdma: on [fixed]

      rx-vlan-filter: on [fixed]

      vlan-challenged: off [fixed]

      tx-lockless: off [fixed]

      netns-local: off [fixed]

      tx-gso-robust: off [fixed]

      tx-fcoe-segmentation: off [fixed]

      tx-gre-segmentation: off [fixed]

      tx-ipip-segmentation: off [fixed]

      tx-sit-segmentation: off [fixed]

      tx-udp_tnl-segmentation: off [fixed]

      fcoe-mtu: off [fixed]

      tx-nocache-copy: off

      loopback: off [fixed]

      rx-fcs: off [fixed]

      rx-all: off [fixed]

      tx-vlan-stag-hw-insert: off [fixed]

      rx-vlan-stag-hw-parse: off [fixed]

      rx-vlan-stag-filter: off [fixed]

      l2-fwd-offload: off [fixed]

      busy-poll: off [fixed]

      hw-tc-offload: off [fixed]

       

       

       

      ///////////////////////////////////////////////////////////////////

      [root@compute01 ~]# tail -f /var/log/messages | grep -i vxlan

      Dec 14 11:24:28 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 14 11:24:28 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 14 11:24:28 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 14 11:24:28 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 14 11:24:30 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      Dec 14 11:24:30 compute01 kernel: vxlan: non-ECT from 192.168.40.55 with TOS=0x2

      ^C

      [root@compute01 ~]# uname -a

      Linux compute01 3.10.0-693.11.1.el7.x86_64 #1 SMP Mon Dec 4 23:52:40 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

      [root@compute01 ~]# ethtool -i eth4

      driver: ixgbe

      version: 5.3.3

      firmware-version: 0x800005b6, 1.1752.0

      expansion-rom-version:

      bus-info: 0000:04:00.0

      supports-statistics: yes

      supports-test: yes

      supports-eeprom-access: yes

      supports-register-dump: yes

      supports-priv-flags: yes

      [root@compute01 ~]# ethtool -k eth4

      Features for eth4:

      rx-checksumming: on

      tx-checksumming: on

              tx-checksum-ipv4: off [fixed]

              tx-checksum-ip-generic: on

              tx-checksum-ipv6: off [fixed]

              tx-checksum-fcoe-crc: on [fixed]

              tx-checksum-sctp: on

      scatter-gather: on

              tx-scatter-gather: on

              tx-scatter-gather-fraglist: off [fixed]

      tcp-segmentation-offload: on

              tx-tcp-segmentation: on

              tx-tcp-ecn-segmentation: off [fixed]

              tx-tcp6-segmentation: on

              tx-tcp-mangleid-segmentation: off

      udp-fragmentation-offload: off [fixed]

      generic-segmentation-offload: on

      generic-receive-offload: on

      large-receive-offload: off

      rx-vlan-offload: on

      tx-vlan-offload: on

      ntuple-filters: off

      receive-hashing: on

      highdma: on [fixed]

      rx-vlan-filter: on

      vlan-challenged: off [fixed]

      tx-lockless: off [fixed]

      netns-local: off [fixed]

      tx-gso-robust: off [fixed]

      tx-fcoe-segmentation: on [fixed]

      tx-gre-segmentation: on

      tx-ipip-segmentation: off [fixed]

      tx-sit-segmentation: off [fixed]

      tx-udp_tnl-segmentation: on

      tx-mpls-segmentation: off [fixed]

      fcoe-mtu: off [fixed]

      tx-nocache-copy: off

      loopback: off [fixed]

      rx-fcs: off [fixed]

      rx-all: off

      tx-vlan-stag-hw-insert: off [fixed]

      rx-vlan-stag-hw-parse: off [fixed]

      rx-vlan-stag-filter: off [fixed]

      busy-poll: on [fixed]

      tx-gre-csum-segmentation: on

      tx-udp_tnl-csum-segmentation: on

      tx-gso-partial: on

      tx-sctp-segmentation: off [fixed]

      l2-fwd-offload: off [fixed]

      hw-tc-offload: off

        1 2 Previous Next