1 2 Previous Next 21 Replies Latest reply on May 19, 2017 9:00 AM by Intel Corporation

    nvme 3608 error msg:  IO queues not created

    Roger_MCH

      Hi all,

       

       

      On my
      server (HPE DL380 G9) I have a Problem with my P3608 4TB Card.

      After about 3 months in operations, I lose the first controller after a reboot, the second one by the next reboot. And now, I can’t access the card with the isdct tool. It seems that the controller is offline.

       

      Short description:

      I have created a raid 0 with two cards (one file system whit 7.4 TB capacity).
      I use a Debian 8 system with the newest SSD firmware (8DV101F0)

      Does anyone have a good idea?


      Thx

      Roger

        • 1. Re: nvme 3608 error msg:  IO queues not created
          Intel Corporation
          This message was posted on behalf of Intel Corporation

          Hello Roger_MCH,

          First of all, we would like to know if you followed these instructions when it was working?

          What kind of workload do you put on the SSD?
          We will be waiting for your response, in case you need further assistance let us know here, or contact our support department.

          Regards,
          NC

          • 2. Re: nvme 3608 error msg:  IO queues not created
            Roger_MCH

            Hello NC,

            Many thanks for your Feedback. We use "Proxmox" as a virtualization solution. This solution is using the Ubuntu 16.04 LTS 4.4 kernel. The driver is activated by default.

            In the current system, I have combine  two P3608 4TB cards to a Raid 0 volume (#zpool create -f -o ashift = 12 ssd_pool /dev/nvme0n1 /dev/nvme1n1 /dev/nvme2n1 /dev/nvme3n1)

            On the server runs a weather application which imports and writes many data. The data can be weather models (large files) or small files like point data.

             

            It is already the second card which has logged off respectively has deactivated. I have opened a support case by Intel; the result was a 1:1 Replacement without any additional information.

             

            Regards,

            Roger

            • 3. Re: nvme 3608 error msg:  IO queues not created
              Intel Corporation
              This message was posted on behalf of Intel Corporation

              Hello Roger_MCH,

              Without performing more troubleshooting and getting more data, it may be hard to positively diagnose the cause of your drive failures.

              However, it might be worth noting that each P3608 counts as two drives. So if you RAID 0 two pairs of these SSDs, it would be the same as creating a RAID 0 array with four SSDs. Which does increase the expected failure rate by about 80%. Perhaps a RAID 10 would be a better option?

              The endurance rating of the Intel® SSD DC P3608 allows for 3 drive writes per day, or 21.90 Petabytes Written. Exceeding this would be another possible cause for the drive to fail earlier than expected.

              In many cases if an SSD fails in a raid, we recommend removing the drive from the array and performing a secure erase/low level format. More often than not, this allows the drive to recover successfully. Although this may have been out of the question if your drives were no longer detected at BIOS level.

              Best regards,
              Carlos A.

              • 4. Re: nvme 3608 error msg:  IO queues not created
                Roger_MCH

                Hi Carlos

                 

                I also think that a Raid 10 would be better but the cost is also much higher. We write about 500GB ~ 700GB data per day to the disc. This should be not a problem.
                Question, how I can do a secure erase/low Level format from the ssd-card respectively from the effected controller?

                Error message for the /var/log/messages

                 

                 

                Dec 14 17:58:51 zuenjv05 kernel: [    9.822799] nvme 0000:87:00.0: Failed status: 0x3, reset controller.

                Dec 14 17:58:51 zuenjv05 kernel: [    9.823291] nvme 0000:87:00.0: Cancelling I/O 0 QID 4

                Dec 14 17:58:51 zuenjv05 kernel: [    9.823294] nvme 0000:87:00.0: Cancelling I/O 1 QID 4

                Dec 14 17:58:51 zuenjv05 kernel: [    9.823296] nvme 0000:87:00.0: Cancelling I/O 2 QID 4

                Dec 14 17:58:51 zuenjv05 kernel: [    9.823298] nvme 0000:87:00.0: Cancelling I/O 0 QID 1

                Dec 14 17:58:51 zuenjv05 kernel: [   11.383135] nvme 0000:87:00.0: IO queues not created



                Some additional details:

                 

                root@zuenjv05:/sys# lspci -nn | grep -i ssd

                0d:00.0 Non-Volatile memory controller [0108]: Intel Corporation PCIe Data Center SSD [8086:0953] (rev 02)

                0e:00.0 Non-Volatile memory controller [0108]: Intel Corporation PCIe Data Center SSD [8086:0953] (rev 02)

                86:00.0 Non-Volatile memory controller [0108]: Intel Corporation PCIe Data Center SSD [8086:0953] (rev 02)

                87:00.0 Non-Volatile memory controller [0108]: Intel Corporation PCIe Data Center SSD [8086:0953] (rev 02)

                 

                root@zuenjv05:/sys#
                find . -name "*nvme*"

                ./bus/pci/drivers/nvme

                ./devices/pci0000:00/0000:00:03.2/0000:0b:00.0/0000:0c:01.0/0000:0d:00.0/nvme

                ./devices/pci0000:00/0000:00:03.2/0000:0b:00.0/0000:0c:01.0/0000:0d:00.0/nvme/nvme0

                ./devices/pci0000:00/0000:00:03.2/0000:0b:00.0/0000:0c:01.0/0000:0d:00.0/nvme/nvme0/nvme0n1

                ./devices/pci0000:00/0000:00:03.2/0000:0b:00.0/0000:0c:02.0/0000:0e:00.0/nvme

                ./devices/pci0000:00/0000:00:03.2/0000:0b:00.0/0000:0c:02.0/0000:0e:00.0/nvme/nvme1

                ./devices/pci0000:00/0000:00:03.2/0000:0b:00.0/0000:0c:02.0/0000:0e:00.0/nvme/nvme1/nvme1n1

                ./devices/pci0000:80/0000:80:02.0/0000:84:00.0/0000:85:01.0/0000:86:00.0/nvme

                ./devices/pci0000:80/0000:80:02.0/0000:84:00.0/0000:85:01.0/0000:86:00.0/nvme/nvme2

                ./devices/pci0000:80/0000:80:02.0/0000:84:00.0/0000:85:02.0/0000:87:00.0/nvme

                ./devices/pci0000:80/0000:80:02.0/0000:84:00.0/0000:85:02.0/0000:87:00.0/nvme/nvme3

                ./block/nvme0n1

                ./block/nvme1n1

                ./class/nvme

                ./class/nvme/nvme0

                ./class/nvme/nvme1

                ./class/nvme/nvme2

                ./class/nvme/nvme3

                ./class/block/nvme0n1

                ./class/block/nvme1n1

                ./module/nvme

                ./module/nvme/drivers/pci:nvme

                 

                  2234 Handle 0x00EC, DMI type 203, 34 bytes

                   2235 OEM-specific Type

                   2236       
                Header and Data:

                   2237                 CB 22 EC 00 FE FF FE FF 86 80
                53 09 86 80 09 37

                   2238                 01 08 EB 00 00 00 10 0A 02 01
                FF FF 01 02 03 04

                   2239                 00 00

                   2240       
                Strings:

                   2241               
                PciRoot(0x0)/Pci(0x3,0x2)/Pci(0x0,0x0)/Pci(0x1,0x0)/Pci(0x0,0x0)

                   2242                 NVMe.Slot.2.1

                   2243                 NVM Express Controller

                   2244                 Slot 2

                   2245

                   2246 Handle 0x00ED, DMI type 203, 34 bytes

                   2247 OEM-specific Type

                   2248       
                Header and Data:

                   2249                 CB 22 ED 00 FE FF FE FF 86 80 53 09 86 80 09
                37

                   2250                 01 08 EB 00 00 00 10 0A 02 02
                FF FF 01 02 03 04

                   2251                 00 00

                   2252       
                Strings:

                   2253               
                PciRoot(0x0)/Pci(0x3,0x2)/Pci(0x0,0x0)/Pci(0x2,0x0)/Pci(0x0,0x0)

                   2254                 NVMe.Slot.2.2

                   2255                 NVM Express Controller

                   2256                 Slot 2

                 

                2282 Handle
                0x00F0, DMI type 203, 34 bytes

                   2283 OEM-specific Type

                   2284       
                Header and Data:

                   2285        
                       CB 22 F0 00 FE FF FE FF 86
                80 53 09 86 80 09 37

                   2286                 01 08 EF 00 00 00 09 0A 05 02
                FF FF 01 02 03 04

                   2287                 00 00

                   2288       
                Strings:

                   2289               
                PciRoot(0x1)/Pci(0x2,0x0)/Pci(0x0,0x0)/Pci(0x1,0x0)/Pci(0x0,0x0)

                   2290                 PCI.Slot.5.2

                   2291                 NVM Express Controller

                   2292                 Slot 5

                   2293

                   2294 Handle 0x00F1, DMI type 203, 34 bytes

                   2295 OEM-specific Type

                   2296       
                Header and Data:

                   2297   
                            CB 22 F1 00 FE FF FE
                FF 86 80 53 09 86 80 09 37

                   2298                 01 08 EF 00 00 00 09 0A 05 03
                FF FF 01 02 03 04

                   2299                 00 00

                   2300       
                Strings:

                   2301               
                PciRoot(0x1)/Pci(0x2,0x0)/Pci(0x0,0x0)/Pci(0x2,0x0)/Pci(0x0,0x0)

                   2302                 PCI.Slot.5.3

                   2303                 NVM Express Controller

                   2304                 Slot 5

                   2305

                 

                 

                 

                 

                 

                root@zuenjv05:/dev#
                dmidecode --type 9

                # dmidecode
                2.12

                SMBIOS 2.8
                present.

                ....

                ....

                Handle
                0x00BC, DMI type 9, 17 bytes

                System Slot
                Information

                                Designation: PCI-E Slot 2

                                Type: x8 PCI Express 3

                                Current Usage: In Use

                                Length: Long

                                Characteristics:

                                               3.3 V is provided

                                               PME signal is
                supported

                                Bus Address: 0000:0b:00.0

                .....

                Handle

                 

                Handle
                0x00BE, DMI type 9, 17 bytes

                System Slot
                Information

                                Designation: PCI-E Slot 5

                                Type: x16 PCI Express 3

                                Current Usage: In Use

                                Length: Long

                                Characteristics:

                                               3.3 V is provided

                                               PME signal is
                supported

                                Bus Address: 0000:84:00.0

                 

                ....

                • 5. Re: nvme 3608 error msg:  IO queues not created
                  Intel Corporation
                  This message was posted on behalf of Intel Corporation

                  Hello Roger_MCH,

                  The same tool we always recommend for monitoring data center drives can also be used to perform a secure erase:

                  - Intel® SSD Data Center Tool (available for Windows*, VMware*, and Linux*).
                  - User and Installation Guides for ISCT.

                  If you haven't already completed the RMA process for your drives, you may try this out and let us know if this helps.

                  Best regards,
                  Carlos A.

                  • 6. Re: nvme 3608 error msg:  IO queues not created
                    Roger_MCH

                    Hi Carlos A.

                     

                    I know the document.

                    I had installed the card in a Windows Workstation, including the Data Center Tool software. The result was the same.

                     

                    Status: Selected drive is in a disable Logical state.

                     

                    P3608_Card2_Error-Msg_disable.jpg

                     

                    What is the possibility to enable the card?

                     

                    It seems that I'm not alone with this problem.

                    P3608_Disable.jpg

                     

                    Merry christmas to you all.

                    Regards,

                    Roger

                    • 7. Re: nvme 3608 error msg:  IO queues not created
                      Intel Corporation
                      This message was posted on behalf of Intel Corporation

                      Hello Roger_MCH,

                      You may try re-seating the drive, and then running the delete command again. But since the drives are part of a raid array, it would be best to try doing this in a different system.

                      However, if it all fails, then the next step would be to proceed with the RMA.

                      We hope you have a wonderful Christmas weekend as well.

                      Best regards
                      Carlos A.

                      • 8. Re: nvme 3608 error msg:  IO queues not created
                        Roger_MCH

                        Hello Carlos A.

                         

                        I removed the card from the source system and installed it in a Windows computer. Unfortunately without any success.

                        Many thanks for your support.
                        Greetings and a happy new year.

                        Roger

                        • 9. Re: nvme 3608 error msg:  IO queues not created
                          Intel Corporation
                          This message was posted on behalf of Intel Corporation

                          Hi Roger_MCH,

                          We understand you removed the SSD and installed it again in a different system (Windows*); but, it is still not working, correct?

                          Can you please let us know what is the status of the LED lights on your SSD?
                          Also, could you please run Intel® SSD Data Center Tool and type: isdct.exe show -a

                          We will be waiting for your response.

                          Regards,
                          NC

                          • 10. Re: nvme 3608 error msg:  IO queues not created
                            Roger_MCH

                            Hi all,

                             

                            I wish you a good start into the new year!

                             

                            The card was installed in an HP DL380 G9 server.
                            I have had removed the (disabled) card from the server and I had installed it in a Windows workstation.

                             

                            The LED status

                             

                            P3608_LED_lights.jpg

                             

                            The command output

                             

                            C:\isdct>isdct.exe show -a -intelssd 0

                            - Intel SSD DC P3608 Series CVF85486002X4P0DGN-1 -

                            AggregationThreshold : Selected drive is in a disable logical state.
                            AggregationTime : Selected drive is in a disable logical state.
                            ArbitrationBurst : Selected drive is in a disable logical state.
                            Bootloader : 8B1B0133
                            CoalescingDisable : Selected drive is in a disable logical state.
                            ControllerCompatibleIDs : PCI\\VEN_8086&DEV_0953&REV_02PCI\\VEN_8086&DEV_0953PCI\\VEN_8086&CC_010802PCI\\VEN_8086&CC_0108PCI\\VEN_8086PCI\\CC_010802PCI\\CC_0108
                            ControllerDescription : @oem168.inf,%pci\\ven_8086&dev_0953.devicedesc%;Intel(R) Solid-State Drive P3700/P3600/P3500/750 Series
                            ControllerID : PCI\\VEN_8086&DEV_0953&SUBSYS_37098086&REV_02\\6&37F79443&0&00080008
                            ControllerIDEMode : False
                            ControllerManufacturer : @oem168.inf,%intel%;Intel
                            ControllerService : IaNVMe
                            DevicePath : \\\\.\\SCSI1:
                            DeviceStatus : *ASSERT_405C786C  AA
                            DriverDescription : Intel(R) Solid-State Drive P3700/P3600/P3500/750 Series
                            DriverMajorVersion : 1
                            DriverManufacturer : Intel
                            DriverMinorVersion : 7
                            ErrorString : *ASSERT_405C786C  AA
                            Firmware : 8DV101F0
                            FirmwareUpdateAvailable : Please contact Intel Customer Support for further assistance at the following website: http://www.intel.com/go/ssdsupport.
                            HighPriorityWeightArbitration : Selected drive is in a disable logical state.
                            IOCompletionQueuesRequested : Selected drive is in a disable logical state.
                            IOSubmissionQueuesRequested : Selected drive is in a disable logical state.
                            Index : 0
                            Intel : True
                            IntelGen3SATA : False
                            IntelNVMe : True
                            InterruptVector : Selected drive is in a disable logical state.
                            LatencyTrackingEnabled : Selected drive is in a disable logical state.
                            LowPriorityWeightArbitration : Selected drive is in a disable logical state.
                            MediumPriorityWeightArbitration : Selected drive is in a disable logical state.
                            ModelNumber : INTEL SSDPECME040T4
                            NVMeControllerID : 0
                            NVMeMajorVersion : 1
                            NVMeMinorVersion : 0
                            NVMePowerState : Selected drive is in a disable logical state.
                            NVMeTertiaryVersion : 0
                            NamespaceId : 4294967295
                            NativeMaxLBA : Selected drive is in a disable logical state.
                            NumErrorLogPageEntries : 63
                            OEM : Generic
                            PCILinkGenSpeed : 3
                            PCILinkWidth : 4
                            PNPString : PCI\\VEN_8086&DEV_0953&SUBSYS_37098086&REV_02\\6&37F79443&0&00080008
                            PowerGovernorMode : Selected drive is in a disable logical state.
                            Product : Fultondale X8
                            ProductFamily : Intel SSD DC P3608 Series
                            ProductProtocol : NVME
                            SCSIPortNumber : 1
                            SMARTEnabled : True
                            SMARTHealthCriticalWarningsConfiguration : Selected drive is in a disable logical state.
                            SMBusAddress : Selected drive is in a disable logical state.
                            SectorSize : 512
                            SerialNumber : CVF85486002X4P0DGN-1
                            TCGSupported : False
                            TempThreshold : Selected drive is in a disable logical state.
                            TimeLimitedErrorRecovery : Selected drive is in a disable logical state.
                            TrimSupported : True
                            VolatileWriteCacheEnabled : Selected drive is in a disable logical state.
                            WriteAtomicityDisableNormal : Selected drive is in a disable logical state.

                             

                             

                             

                            C:\isdct>isdct.exe show -a -intelssd 1

                            - Intel SSD DC P3608 Series CVF85486002X4P0DGN-2 -

                            AggregationThreshold : Selected drive is in a disable logical state.
                            AggregationTime : Selected drive is in a disable logical state.
                            ArbitrationBurst : Selected drive is in a disable logical state.
                            Bootloader : 8B1B0133
                            CoalescingDisable : Selected drive is in a disable logical state.
                            ControllerCompatibleIDs : PCI\\VEN_8086&DEV_0953&REV_02PCI\\VEN_8086&DEV_0953PCI\\VEN_8086&CC_010802PCI\\VEN_8086&CC_0108PCI\\VEN_8086PCI\\CC_010802PCI\\CC_0108
                            ControllerDescription : @oem168.inf,%pci\\ven_8086&dev_0953.devicedesc%;Intel(R) Solid-State Drive P3700/P3600/P3500/750 Series
                            ControllerID : PCI\\VEN_8086&DEV_0953&SUBSYS_37098086&REV_02\\6&146834E4&0&00100008
                            ControllerIDEMode : False
                            ControllerManufacturer : @oem168.inf,%intel%;Intel
                            ControllerService : IaNVMe
                            DevicePath : \\\\.\\SCSI2:
                            DeviceStatus : *ASSERT_405C786C  NK
                            DriverDescription : Intel(R) Solid-State Drive P3700/P3600/P3500/750 Series
                            DriverMajorVersion : 1
                            DriverManufacturer : Intel
                            DriverMinorVersion : 7
                            ErrorString : *ASSERT_405C786C  NK
                            Firmware : 8DV101F0
                            FirmwareUpdateAvailable : Please contact Intel Customer Support for further assistance at the following website: http://www.intel.com/go/ssdsupport.
                            HighPriorityWeightArbitration : Selected drive is in a disable logical state.
                            IOCompletionQueuesRequested : Selected drive is in a disable logical state.
                            IOSubmissionQueuesRequested : Selected drive is in a disable logical state.
                            Index : 1
                            Intel : True
                            IntelGen3SATA : False
                            IntelNVMe : True
                            InterruptVector : Selected drive is in a disable logical state.
                            LatencyTrackingEnabled : Selected drive is in a disable logical state.
                            LowPriorityWeightArbitration : Selected drive is in a disable logical state.
                            MediumPriorityWeightArbitration : Selected drive is in a disable logical state.
                            ModelNumber : INTEL SSDPECME040T4
                            NVMeControllerID : 0
                            NVMeMajorVersion : 1
                            NVMeMinorVersion : 0
                            NVMePowerState : Selected drive is in a disable logical state.
                            NVMeTertiaryVersion : 0
                            NamespaceId : 4294967295
                            NativeMaxLBA : Selected drive is in a disable logical state.
                            NumErrorLogPageEntries : 63
                            OEM : Generic
                            PCILinkGenSpeed : 3
                            PCILinkWidth : 4
                            PNPString : PCI\\VEN_8086&DEV_0953&SUBSYS_37098086&REV_02\\6&146834E4&0&00100008
                            PowerGovernorMode : Selected drive is in a disable logical state.
                            Product : Fultondale X8
                            ProductFamily : Intel SSD DC P3608 Series
                            ProductProtocol : NVME
                            SCSIPortNumber : 2
                            SMARTEnabled : True
                            SMARTHealthCriticalWarningsConfiguration : Selected drive is in a disable logical state.
                            SMBusAddress : Selected drive is in a disable logical state.
                            SectorSize : 512
                            SerialNumber : CVF85486002X4P0DGN-2
                            TCGSupported : False
                            TempThreshold : Selected drive is in a disable logical state.
                            TimeLimitedErrorRecovery : Selected drive is in a disable logical state.
                            TrimSupported : True
                            VolatileWriteCacheEnabled : Selected drive is in a disable logical state.
                            WriteAtomicityDisableNormal : Selected drive is in a disable logical state.


                            C:\isdct>

                             

                            The same output from a other p3608 card in a running Linux system (only Controller 0)

                             

                            # isdct show -a -intelssd 0

                            - Intel SSD DC P3608 Series CVF85371000G3P2CGN-1 -

                            AggregationThreshold : 0
                            AggregationTime : 0
                            ArbitrationBurst : 0
                            Bootloader : 8B1B0133
                            CoalescingDisable : 1
                            DevicePath : /dev/nvme0n1
                            DeviceStatus : Healthy
                            EndToEndDataProtCapabilities : 17
                            EnduranceAnalyzer : 186.65 years
                            ErrorString :
                            Firmware : 8DV101F0
                            FirmwareUpdateAvailable : The selected Intel SSD contains current firmware as of this tool release.
                            HighPriorityWeightArbitration : 0
                            IOCompletionQueuesRequested : 30
                            IOSubmissionQueuesRequested : 30
                            Index : 0
                            Intel : True
                            IntelGen3SATA : False
                            IntelNVMe : True
                            InterruptVector : 0
                            LBAFormat : 0
                            LatencyTrackingEnabled : False
                            LowPriorityWeightArbitration : 0
                            MaximumLBA : 3125627567
                            MediumPriorityWeightArbitration : 0
                            MetadataSetting : 0
                            ModelNumber : INTEL SSDPECME032T4
                            NVMeControllerID : 0
                            NVMeMajorVersion : 1
                            NVMeMinorVersion : 0
                            NVMePowerState : 0
                            NVMeTertiaryVersion : 0
                            NamespaceId : 1
                            NativeMaxLBA : 3125627567
                            NumErrorLogPageEntries : 63
                            NumLBAFormats : 6
                            OEM : Generic
                            PCILinkGenSpeed : 3
                            PCILinkWidth : 4
                            PowerGovernorMode : 0 40W for 8 Lane Slot power
                            Product : Fultondale X8
                            ProductFamily : Intel SSD DC P3608 Series
                            ProductProtocol : NVME
                            ProtectionInformation : 0
                            ProtectionInformationLocation : 0
                            SMARTEnabled : True
                            SMARTHealthCriticalWarningsConfiguration : 0
                            SMBusAddress : 106
                            SectorSize : 512
                            SerialNumber : CVF85371000G3P2CGN-1
                            TCGSupported : False
                            TempThreshold : 85
                            TimeLimitedErrorRecovery : 0
                            TrimSupported : True
                            VolatileWriteCacheEnabled : False
                            WriteAtomicityDisableNormal : 0

                             

                            Many thanks for your support.

                            Regards,

                            Roger

                            • 11. Re: nvme 3608 error msg:  IO queues not created
                              Intel Corporation
                              This message was posted on behalf of Intel Corporation

                              Hello Roger_MCH,

                              Happy new year as well!

                              From what we can see, the drive keeps showing as disabled logical state, but the light is solid green.
                              We need to ask you first, do you have another P3608 card? The one tested in Linux?

                              This because that one shows just fine, as it should, when you ran the command and checking the ISNs of each card, we do see those are different. If this is the case, we suggest you to get in touch with our support department to get further assistance.
                              Please let us know once you get in contact with them.

                              Regards,
                              NC
                               

                              • 12. Re: nvme 3608 error msg:  IO queues not created
                                Roger_MCH

                                Hi NC,

                                 

                                What do you mean with checking the ISNs (Intel Software Network)? 

                                 

                                Yes, we had bought a lot of these cards.

                                And yes, I had opened two Intel support tickets (01911082 and 02193992) from a long time. But the answer respectively the analyze/resolving from the problem is/was not very helpful.

                                 

                                Thanks again for your support.

                                Regards,

                                Roger

                                • 13. Re: nvme 3608 error msg:  IO queues not created
                                  Intel Corporation
                                  This message was posted on behalf of Intel Corporation

                                  Hi Roger_MCH,

                                  First of all, the ISN is the number we use on each SSD as an identifier and it is unique. (Kind of like a serial number).

                                  We will verify the case numbers you provided and we will get back to you with a response.

                                  Regards,
                                  NC

                                  • 14. Re: nvme 3608 error msg:  IO queues not created
                                    Intel Corporation
                                    This message was posted on behalf of Intel Corporation

                                    Hello Roger_MCH,

                                    Let us inform you that both cases are escalated and our engineering team is working on this. We will get back to you soon, either from this thread or by e-mail.

                                    Regards,
                                    NC

                                    1 2 Previous Next