2 Replies Latest reply on Oct 17, 2017 6:03 AM by Intel Corporation

    Omni-path HBA in Polling state were as an identical machine connected to same fabric Link is Up

    pharthiphan

      Omni-path HBA in Polling state were as an identical machine [Same OS distro and Omni-path driver] connected to same fabric Link is Up

       

      cat /etc/centos-release

      CentOS Linux release 7.3.1611 (Core)

       

      Omni-path driver

       

      IntelOPA-IFS.RHEL73-x86_64.10.3.1.0.22

       

      ibstat

      CA 'hfi1_0'

              CA type:

              Number of ports: 1

              Firmware version:

              Hardware version: 11

              Node GUID: 0x001175010179001c

              System image GUID: 0x001175010179001c

              Port 1:

                      State: Down

                      Physical state: Polling

                      Rate: 100

                      Base lid: 0

                      LMC: 0

                      SM lid: 0

                      Capability mask: 0x00410020

                      Port GUID: 0x001175010179001c

                      Link layer: InfiniBand

      CA 'hfi1_1'

              CA type:

              Number of ports: 1

              Firmware version:

              Hardware version: 11

              Node GUID: 0x001175010178ced9

              System image GUID: 0x001175010179001c

              Port 1:

                      State: Down

                      Physical state: Polling

                      Rate: 100

                      Base lid: 0

                      LMC: 0

                      SM lid: 0

                      Capability mask: 0x00410020

                      Port GUID: 0x001175010178ced9

                      Link layer: InfiniBand

      CA 'hfi1_2'

              CA type:

              Number of ports: 1

              Firmware version:

              Hardware version: 11

              Node GUID: 0x001175010178ced7

              System image GUID: 0x001175010179001c

              Port 1:

                      State: Down

                      Physical state: Polling

                      Rate: 100

                      Base lid: 0

                      LMC: 0

                      SM lid: 0

                      Capability mask: 0x00410020

                      Port GUID: 0x001175010178ced7

                      Link layer: InfiniBand

      CA 'hfi1_3'

              CA type:

              Number of ports: 1

              Firmware version:

              Hardware version: 11

              Node GUID: 0x001175810179001c

              System image GUID: 0x001175010179001c

              Port 1:

                      State: Down

                      Physical state: Polling

                      Rate: 100

                      Base lid: 0

                      LMC: 0

                      SM lid: 0

                      Capability mask: 0x00410020

                      Port GUID: 0x001175810179001c

                      Link layer: InfiniBand

       

      ibstat hfi1_0

      CA 'hfi1_0'

              CA type:

              Number of ports: 1

              Firmware version:

              Hardware version: 11

              Node GUID: 0x001175010179001c

              System image GUID: 0x001175010179001c

              Port 1:

                      State: Down

                      Physical state: Polling

                      Rate: 100

                      Base lid: 0

                      LMC: 0

                      SM lid: 0

                      Capability mask: 0x00410020

                      Port GUID: 0x001175010179001c

                      Link layer: InfiniBand

       

      5: ib0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 65520 qdisc pfifo_fast state DOWN qlen 256

          link/infiniband 80:00:00:02:fe:80:00:00:00:00:00:00:00:11:75:01:01:79:00:1c brd 00:ff:ff:ff:ff:12:40:1b:80:00:00:00:00:00:00:00:ff:ff:ff:ff

          inet 10.10.27.32/24 brd 10.10.27.255 scope global ib0

             valid_lft forever preferred_lft forever

      6: ib1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 2044 qdisc pfifo_fast state DOWN qlen 256

          link/infiniband 80:00:00:02:fe:80:00:00:00:00:00:00:00:11:75:01:01:78:ce:d9 brd 00:ff:ff:ff:ff:12:40:1b:80:00:00:00:00:00:00:00:ff:ff:ff:ff

          inet 10.10.27.21/24 brd 10.10.27.255 scope global ib1

             valid_lft forever preferred_lft forever

      7: ib2: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 2044 qdisc pfifo_fast state DOWN qlen 256

          link/infiniband 80:00:00:02:fe:80:00:00:00:00:00:00:00:11:75:01:01:78:ce:d7 brd 00:ff:ff:ff:ff:12:40:1b:80:00:00:00:00:00:00:00:ff:ff:ff:ff

          inet 10.10.27.22/24 brd 10.10.27.255 scope global ib2

             valid_lft forever preferred_lft forever

      8: ib3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 2044 qdisc pfifo_fast state DOWN qlen 256

          link/infiniband 80:00:00:02:fe:80:00:00:00:00:00:00:00:11:75:81:01:79:00:1c brd 00:ff:ff:ff:ff:12:40:1b:80:00:00:00:00:00:00:00:ff:ff:ff:ff

          inet 10.10.27.23/24 brd 10.10.27.255 scope global ib3

             valid_lft forever preferred_lft forever

       

      opainfo

      hfi1_0:1                           PortGUID:0x001175010179001c

         PhysicalState: Polling

         LinkSpeed      En: 25Gb         Sup: 25Gb

         LinkWidth      En: 4            Sup: 1,2,3,4

         LCRC           En: 14-bit,16-bit,48-bit     Sup: 14-bit,16-bit,48-bit

      hfi1_1:1                           PortGUID:0x001175010178ced9

         PhysicalState: Polling

         LinkSpeed      En: 25Gb         Sup: 25Gb

         LinkWidth      En: 4            Sup: 1,2,3,4

         LCRC           En: 14-bit,16-bit,48-bit     Sup: 14-bit,16-bit,48-bit

      hfi1_2:1                           PortGUID:0x001175010178ced7

         PhysicalState: Polling

         LinkSpeed      En: 25Gb         Sup: 25Gb

         LinkWidth      En: 4            Sup: 1,2,3,4

         LCRC           En: 14-bit,16-bit,48-bit     Sup: 14-bit,16-bit,48-bit

      hfi1_3:1                           PortGUID:0x001175810179001c

         PhysicalState: Polling

         LinkSpeed      En: 25Gb         Sup: 25Gb

         LinkWidth      En: 4            Sup: 1,2,3,4

         LCRC           En: 14-bit,16-bit,48-bit     Sup: 14-bit,16-bit,48-bit