From what I have read thus far and seen from people's feelings, it looks like the baseline Mac Pro may only be slightly better than the high end iMac 27".
Quad core Xeon against Haswell i7.
It seems the benefits come rapidly after the base configuration, once you start paying triple the price of the iMac.
Nothing can be proven fact until the benchmarks and user reviews are out, however.