The chipset inf is not a driver. Rather, it defines the names for devices you have, which in turn find the proper driver. it sounds like you have a desktop with both Intel and NVidia operating concurrently.
Let's say that you have just uninstalled the graphics driver. You can use the WUShowHide https://support.microsoft.com/en-us/kb/3073930 to prevent the driver from being re-installed.
I would also check the bios to see if you can disable the Intel graphics.
This message was posted on behalf of Intel Corporation
Thank you very much to Al Hill for the information posted previously.
I hope the information posted above was useful for you, I just wanted to confirm it as correct and by following those instructions you will able to remove the chipset driver.