AMD HD7950 is the best you can get without any modifications and stay within the PSU limits. You can have 4K or Retina resolution with he right monitor at 60Hz. Search within this section of the forum and you will see more info.
Yes, if you have OSX 10.9+ they're all fully supported, just without boot screen.
If you flash the card with Mac EFI you have boot screen but not with 4K monitor.
if your still on osx 10.7 then it recommends
"If you are stuck with a MacPro1,1 or MacPro2,1 then your options are slightly different, since the Kepler cards don't work in Lion.
If you have an unlimited budget, get a GTX 570.
Otherwise, get a GTX 560 or GTX 560 Ti.
I think it's unlikely that the Kepler cards will ever be supported on Lion, which does limit the options for older Mac Pro systems."
Many AMD and Nvidia cards are supported in OS X by default.
Some AMD and Nvidia cards have no driver support in OS X at all.
Some Nvidia cards require Nvidia drivers in OS X. (But if OP is stuck at Lion these aren't relevant anyway.)