The RX580 drivers are included as a part of the operating system, but Apple's "officially supported" list of tested cards is limited to a few specific brands & models. Do you have another GPU to test with, possibly in a different slot to see if the RX580 shows up when plugged in etc?