use a 2x SATA -> 8pin sure is safer setup.
What I will do is to power the card with only the both mini 6pin -> 8pin.
Then run Luxmark 2 (NOT Luxmark 3). It's less demanding, so less chance to shutdown the Mac if the max power draw is really high.
During the power draw test, use iStat or HWMonitor to capture the max power draw of each 6pin.
Hopefully the power draw is quite even distributed.
In any case, after the test, let the 2x mini 6pin to drive the more demanding 8pin, and 2x SATA drive the less demanding 8pin.
And now you should able to safely run Luxmark 3, Unigine Valley, or Unigine Heaven, etc... and monitor the power draw again. The 6pins should be well within the limit (75W each). Pay more attention on the SATA port power draw, the standard limit is 54W from each of the SATA port (or <4.5A if you monitor the current via iStat). Since you only use the SATA ports to drive the less demanding 8pin, they should stay within the limit. Or in worst case, just slightly over the limit (if your 980Ti do make good use of the PCIe slot power).
Of course, you can run the Luxmark 2 test with the 2x SATA -> 8pin + 2x mini 6pin -> 8pin (random order), and find out if it's drawing too much from the SATA port, and then swap cable if require. However, we know that there is a safety mechanism in the mini 6pin to protect the Mac, but we don't know if there is any protection for the SATA port. So, IMO, it may be actually safer to run this power draw test with just the mini 6pin -> 8pin adaptor (as long as the power draw is not extreme).