The video card alone is worth it to me. I have a mini with integrated graphics and it's great-- plays HD just fine. But I would like to run some heavy 3D games and can't.
With Macs, it's generally good to spend a little more up front if you can. For the two machines you're looking at, I think there's a lot more going for the more expensive one based on graphics alone.