9 Replies Latest reply on Oct 9, 2017 11:18 AM by Intel Corporation

    Non paged memory issue with HD630

    mathieuL

      Hi folks,

       

      I have a Windows 10 x64 virtual machine (KVM hypervisor) that passtrough (VFIO) the igpu of my intel g4600. The issue is that I have a huge non paged memory pool, so I used the poolmon utility and I discovered that the intel memory manager (@GMM) is the cause of it.

       

      Can you help me with this?

       

      Thanks, Mathieu.

       

      image.png.97a523973682eb481ae2e04c21f3c9f0.png

        • 1. Re: Non paged memory issue with HD630
          Intel Corporation
          This message was posted on behalf of Intel Corporation

          Hello mathieuL ,

           


          Thank you for reaching the Intel(R) Communities. I understand you are having some troubles with the Memory pool on your system. We can certainly check on this to find a possible explanation or source of this behavior.

           

           

          I would like to check some facts to proceed accordingly:

           

           

          • How is the tool "poolmon utility" indicating the problem is from the memory manager? What indicates that?
          • With that memory pool there, how is the system affected? How? What is its behavior?
          • Please attach the report from Intel® System Support Utility to your answer to have a clearer understanding of the scenario faced in terms of hardware

           

           

          If further information is relevant, feel free to add it as well.

           

          How to get the Intel® System Support Utility?

           

          It can be downloaded here: https://downloadcenter.intel.com/download/25293/Intel-System-Support-Utility-for-Windows-

           


          Thank,
          Esteban C

          • 2. Re: Non paged memory issue with HD630
            mathieuL

            First of all, thanks for your fast answer, it is appreciated.

             

            How is the tool "poolmon utility" indicating the problem is from the memory manager? What indicates that?

            The list of all the tags are repertoried on this web page : https://blogs.technet.microsoft.com/yongrhee/2009/06/23/pool-tag-list/ .

            As you can see the tag @GMM refers to the Intel Video Driver Memory Manager. Under the Bytes column in the image below, you can see that the memory allocation for this tag is roughly 4.3Gb. Also, it's a non paged type of allocation, which mean the users cannot have access to this pool of memory.

            image.png.97a523973682eb481ae2e04c21f3c9f0.png

             

            With that memory pool there, how is the system affected? How? What is its behavior?

            The iGPU seems to work perfectly, I can watch 4k videos and I don't see any artefacts. However, my memory usage is very high, even when the OS is at idle, as you can see in the screenshot below. It doesn't take much to fills the 2.7G of available memory when browsing the web. 

            Please attach the report from Intel® System Support Utility to your answer to have a clearer understanding of the scenario faced in terms of hardware

            The report is attached to this post.

             

            Thanks for your help, Mathieu

            • 3. Re: Non paged memory issue with HD630
              Intel Corporation
              This message was posted on behalf of Intel Corporation

              Thank you for the information provided, mathieuL


              Some other data to be checked:

              • What is the VM software used for this configuration?
              • Are you facing the same problem while using Windows 10* on the base system? (Without VM)
              • What is the brand and model number of the system you have or the motherboard? (Report did not provide that information properly)

               

               

              That is to find out what else could be affecting this behavior.

               

               


              Thanks,
              Esteban C

              • 4. Re: Non paged memory issue with HD630
                mathieuL

                What is the VM software used for this configuration?

                The VM is running on unRAID 6.3.5 which as KVM/QEMU built-in.

                • QEMU 2.7.1
                • libvirt 2.4.0

                 

                Are you facing the same problem while using Windows 10* on the base system? (Without VM)

                I cannot provide you this information since I never run Windows 10 directly on the computer without being virtualized.

                 

                What is the brand and model number of the system you have or the motherboard?

                 

                CPU: Intel G4600

                GPU: Intel HD 630

                SSD: Intel 600p 256GB

                RAM: Crucial 2x8GB DDR4-2133 CT8G4DFD8213

                MOBO: Gigabyte B150N-GSM (BIOS F22a)

                PSU: Seasonic SSR-350ST

                 

                • 5. Re: Non paged memory issue with HD630
                  Intel Corporation
                  This message was posted on behalf of Intel Corporation

                  Thank you for the data, mathieuL

                   

                  Since this is not a regular windows 10* environment, plenty of things can affect the functionality of the memory controller.

                   


                  For that reason, I would like to recommend reporting this issue to the developers of the VM software used and to Microsoft's support team as well so they can analyze the current behavior of Windows 10* and let you know if this is ok or not.

                   

                   

                  If they request us to collaborate we would be welcome to do so. (if applicable)

                   


                  Thanks,
                  Esteban C

                  • 6. Re: Non paged memory issue with HD630
                    mathieuL

                    Intel Corporation a écrit:

                     

                    Thank you for the data, mathieuL

                     

                    Since this is not a regular windows 10* environment, plenty of things can affect the functionality of the memory controller.

                     


                    For that reason, I would like to recommend reporting this issue to the developers of the VM software used and to Microsoft's support team as well so they can analyze the current behavior of Windows 10* and let you know if this is ok or not.

                     

                     

                    If they request us to collaborate we would be welcome to do so. (if applicable)

                     


                    Thanks,
                    Esteban C

                     

                    Okay, I understand the situation. I'm already on the  unRAID forum, but I have no feedback at the moment. Although, another user reported to have the same issue as me.

                    https://forums.lime-technology.com/topic/60107-635-passing-through-intel-igd-with-win10-abnormally-high-mem-usage/?tab=comments#comment-594514

                     

                    If you're able to reach someone from Microsoft or someone with the knowledge to help, it would be nice.

                     

                    Regards, Mathieu

                    • 7. Re: Non paged memory issue with HD630
                      Intel Corporation
                      This message was posted on behalf of Intel Corporation

                      Thank you for reporting back.

                      Feel free to let us know if this is something from their software or the memory controller when they report back. To proceed accordingly.


                      Regards,
                      Esteban C

                      • 8. Re: Non paged memory issue with HD630
                        mathieuL

                        Conversation between vfio-users@redhat.com and me :

                         

                        Thanks for your help !

                         

                        I've added this to my Windows 10 XML config and the memory issue is gone:

                          <qemu:commandline>

                            <qemu:arg value='-set'/>

                            <qemu:arg value='device.hostdev0.x-igd-opregion=on'/>

                            <qemu:arg value='-set'/>

                            <qemu:arg value='device.hostdev0.x-igd-gms=1'/>

                          </qemu:commandline>

                         

                        Regards, Mathieu

                         

                        -----Message d'origine-----

                        De : Alex Williamson [mailto:alex.williamson@redhat.com]

                        Envoyé : 7 octobre 2017 16:31

                        À : mathieu@lesperance.cloud

                        Cc : vfio-users@redhat.com

                        Objet : Re: [vfio-users] Skylake IGD + Windows 10 VM = 4.3Gb of non paged memory

                         

                        On Sat, 7 Oct 2017 15:37:32 -0400

                        <mathieu@lesperance.cloud> wrote:

                         

                        > Hi folks,

                        >

                        >

                        > I have a Windows 10 VM running on unRAID 6.3.5 which as KVM/QEMU

                        > built-in (QEMU 2.7.1 / libvirt 2.4.0), which I passthrough a Skylake

                        > IGD in legacy mode. The video output works fine, however, the issue is

                        > that the intel video driver memory manager stole 4.3GB and put it in a

                        > non-paged memory pool. That mean that on my 8GB of ram in my VM, only

                        > 3.7GB is available to the user. If I assign less than 4GB, the intel IGD wont work at all.

                        >

                        >

                        > I've read about the fw_cfg that need some configuration for IGD, but I

                        > didn't find any prebuild file for an IGD nor the source files to build

                        > the binaries.

                        >

                        >

                        > I have open threads in two other forum but no success so far:

                        >

                        >

                        > https://forums.lime-technology.com/topic/60107-635-passing-through-int

                        > el-igd -with-win10-abnormally-high-mem-usage/

                        >

                        >

                        > https://communities.intel.com/thread/118393

                        >

                        >

                        > Thanks for your help, Mathieu.

                         

                        There are versions of the IGD Windows driver that freak out when they find zero stolen memory reserved, the workaround is to add the parameter x-igd-gms=1 to the parameter list for the device.  Intel has indicated that they intend to fix this in the Windows driver, so updating to the latest Intel driver release may also be enough to resolve it.  See:

                         

                        https://lists.gnu.org/archive/html/qemu-devel/2017-07/msg08092.html

                         

                        Thanks,

                                                                                                                                               

                        Alex

                        • 9. Re: Non paged memory issue with HD630
                          Intel Corporation
                          This message was posted on behalf of Intel Corporation

                          Hello mathieuL,

                           


                          I am glad to hear you found a solution for this situation.

                           

                          Thank you for reporting back with the resolution.

                           

                          If you happen to have further questions, feel free to contact us back.

                           


                          Thanks,
                          Esteban C