Not a good sign. I had a brief discussion with
@Ooze, who explained that he had the same problems when he attempted the first boots with the wx7100. So couple of tips he gave me based on his experience. (I know that some might have had an easier journey with the card)
1. NVRAM reset while you have a working computer. That is before tou disadsemble to put the WX7100 in.
2. SMC resets - several of them - take the plug out for long time (over night even - I am not sure if that is going to really help but he explained that eventually was able to turn the iMac on after several attempts of these attempts)
3. Use only one RAM stick - this should probably be done on the board recommended slot (I still did not search which one should it be but usually boards have slot recommendations for one, two or 3 slots.
4. Use only one drive (preferably SSD) in SATA 0 position - disconnect all other storage devices. ooze did it with Windows but I cannot say if that makes a difference.
5. Make absolutely sure there is no short on the heatsink. (My experience with 4170 taught me to use a little bit of electrical tape on the components left of the GPU when looking at it from the top.
Don’t give up. Specially with the resets and taking the cable out. It should be that once you will be able to start it will remain stable.
One more thing. Ooze was starting with Dell vbios (one that came with the card and remoted in to flash). I believe that once you are able to boot with the card in, it should be fairly easy to progress.
I am still waiting for my card replacement so will do all these things later. Holding fingers crossed for you.