How are you powering the audio card, usually the Edison's output power is not enough to power up a peripheral such as this, and probably that's what happening to you.
Also, remember that if you want to use the Edison as host, the Edison's micro-switch must be facing the full-USB port, otherwise the USB port won't even be enabled and you won't be able to the detect the peripheral.
If the issue is the power of the audio card then remember to wire together the audio card's ground to the Edison's ground, otherwise the audio card won't receive the Edison's signals.
Yeah it is working now. Earlier I was trying to power it up from the USB ports but now when I put the power adapter and turned the micro-switch to the other side it started working.Thanks.