Remove and then re-add VMDirectPath Hardware?

So my questino is fairly straight forward. First - I know this is completely unsupported, etc. This is my home/personal setup - I don't need or expect any support. Its for fun Anyhow, i have a 5.1 esxi host that I am using VMDirectPath on. I have two PCI devices (Hauppauge Colossus capture cards) that I am passing throught to a guest. Basically I am using a piece of software for the pvr now, and I would like to try out different one one. What I want to know is can I do the following.

1. power off VM-1 (which has the capture cards assigned to it now via vmdirectpath)
2. Remove the two vmdirect path devices from VM-1 in vSphere, via edit settings.
3. Create a new VM-2,
4. add the 2 cards to the new server
5. If I decide I want to revert back, shutdown vm-2, remove two devices
6. Add the hardware back to VM-1 and boot it up

If I do go to steps 4 & 5, will the guest OS in VM-1 know that anything happened? Is there any sort of unique ID that might change, etc? I am basically hoping that I can remove the hardware, and as long as I never boot it until they have been re-added, the guest will be none-the-wiser. Will it work? I don't really want to learn the hard way because there is a fairly significant amount of configuration time invested that I really don't want to start over...

Thanks,

Mike