Are you enabling the driver using menuconfig? Are you following any specific guide? Take a look at Reconfiguring Linux kernel and adding drivers into Galileo's Linux image . This guide will show you the steps to enable the driver in your image.
Let me know your results.
That post is really helpful. With the generation of .ipk file, I can just copy it to the board and install it using OPKG. That saves much of the efforts that I usually undergo to make the module enablement using menuconfig by following the above mentioned tedious steps. With that in another place, now my aim is to make changes in the driver , viz., adding some debug statements . What will be the steps needed to apply some driver change as a patch to my Yocto image??